公开(公告)号：US20230330873A1

公开(公告)日：2023-10-19

申请号：US18132791

申请日：2023-04-10

Applicant: SAMSUNG ELECTRONICS CO, Ltd.

Inventor： Siddharth RUPAVATHARAM ,  Xiaoran FAN ,  Daewon LEE ,  Richard HOWARD ,  Lawrence JACKEL ,  Ibrahim Volkan ISLER ,  Daniel LEE

IPC: B25J19/02 ,  B25J9/16

CPC classification number: B25J19/026 ,  B25J9/161 ,  B25J9/1656 ,  B25J9/1676 ,  B25J19/028

Abstract: An apparatus for estimating a proximity direction of an obstacle includes an acoustic transmitter attached to a surface of the apparatus; a first acoustic receiver spaced apart from the surface of the apparatus; a second acoustic receiver spaced apart from the surface of the apparatus; and at least one processor configured to: control the acoustic transmitter to generate an acoustic wave along the surface; obtain first and second proximity direction signals based on first and second acoustic wave signals corresponding to the generated acoustic wave; and estimate a proximity direction of the obstacle with respect to the apparatus based on the first and second proximity direction signals.

公开(公告)号：US20240091951A1

公开(公告)日：2024-03-21

申请号：US18367827

申请日：2023-09-13

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Nikhil Narsingh CHAVAN DAFLE ,  Vasileios VASILOPOULOS ,  Shubham AGRAWAL ,  Jinwook HUH ,  Suveer GARG ,  Pedro PIACENZA ,  Isaac Hisano KASAHARA ,  Kazim Selim ENGIN ,  Zhanpeng HE ,  Shuran SONG ,  Ibrahim Volkan ISLER

IPC: B25J9/16 ,  G06T7/60 ,  G06T7/73

CPC classification number: B25J9/1697 ,  B25J9/1612 ,  B25J9/163 ,  G06T7/60 ,  G06T7/73 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: Systems, methods, and apparatuses for controlling a robot including a manipulator, including: determining three-dimensional (3D) geometry information about a target object based on an image of the target object; determining 3D geometry information about a scene in which the target object is to be placed based on at least one image of the scene; obtaining affordance information by providing the 3D geometry information about the target object and the 3D geometry information about the scene to at least one neural network model; commanding the robot to grasp the target object using the manipulator according to a grasp orientation corresponding to the affordance information; and commanding the robot to position the manipulator according to a placement direction corresponding to the affordance information in order to place the target object at a location in the scene.

公开(公告)号：US20210283785A1

公开(公告)日：2021-09-16

申请号：US16926289

申请日：2020-07-10

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Yuan CHEN ,  Colin PREPSCIUS ,  Dae Won LEE ,  Ibrahim Volkan ISLER ,  Daniel Dongyuel LEE

IPC: B25J13/08 ,  B25J9/16 ,  B25J15/08

Abstract: A tool control system may include: a tactile sensor configured to, when a tool holds a target object and slides the target object downward across the tool, obtain tactile sensing data from the tool; one or more memories configured to store a target velocity and computer-readable instructions; and one or more processors configured execute the computer-readable instructions to: receive the tactile sensing data from the tactile sensor; estimate a velocity of the target object based on the tactile sensing data, by using one or more neural networks that are trained based on a training image of an sample object captured while the sample object is sliding down; and generate a control parameter of the tool based on the estimated velocity and the target velocity.

公开(公告)号：US20250094731A1

公开(公告)日：2025-03-20

申请号：US18614200

申请日：2024-03-22

Applicant: SAMSUNG ELECTRONICS CO, LTD.

Inventor： Moritz Alexander GRAULE ,  Ibrahim Volkan ISLER

IPC: G06F40/40

Abstract: A method includes receiving data from one or more sensors, detecting, from the received data, one or more activities of a person in a space, converting the detected one or more activities into a natural language narration; extracting one or more items from a map corresponding to the space; determining a relevancy score for each of the extracted one or more items based on an output of a language model that receives as input a combination of the narration with a binding sequence; correlating the extracted one or more items with one or more locations on the map based on the determined relevancy for each of the extracted one or more items; and outputting a control signal for controlling a movement of one more devices based on the correlation of the extracted one or more items with the one or more locations on the map.

公开(公告)号：US20210293918A1

公开(公告)日：2021-09-23

申请号：US17084257

申请日：2020-10-29

Applicant: Samsung Electronics Co., Ltd.

Inventor： Xiaoran FAN ,  Yuan CHEN ,  Dae Won LEE ,  Colin PREPSCIUS ,  Ibrahim Volkan ISLER ,  Lawrence David JACKEL ,  Hyunjune Sebastian SEUNG ,  Daniel Dongyuel LEE

IPC: G01S5/22 ,  B25J19/02

Abstract: A method of collision localization on a robotic device includes obtaining audio signals from a plurality of acoustic sensors spaced apart along the robotic device; identifying, based on a collision being detected, a strongest audio signal; identifying a primary onset time for an acoustic sensor producing the strongest audio signal, the primary onset time being a time at which waves propagating from the collision reach the acoustic sensor producing the strongest audio signal; generating a virtual onset time set, by shifting a calibration manifold, based on the identified primary onset time, the calibration manifold representing relative onset times from evenly spaced marker locations on the robotic device to the plurality of acoustic sensors; determining scores for the marker locations based a standard deviation of elements in the virtual onset time set; and estimating a location of the collision based on a highest score of the determined scores.

公开(公告)号：US20240312166A1

公开(公告)日：2024-09-19

申请号：US18400889

申请日：2023-12-29

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Isaac Hisanao KASAHARA ,  Shubham AGRAWAL ,  Kazim Selim ENGIN ,  Nikhil Narsingh CHAVAN DAFLE ,  Shuran SONG ,  Ibrahim Volkan ISLER

IPC: G06T19/20 ,  G05D1/622 ,  G06T5/77 ,  G06T7/13 ,  G06T15/10 ,  G06T15/40 ,  G06T17/20

CPC classification number: G06T19/20 ,  G05D1/622 ,  G06T5/77 ,  G06T7/13 ,  G06T15/10 ,  G06T15/40 ,  G06T17/20 ,  G05D2101/15 ,  G05D2105/10 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2210/56 ,  G06T2219/004 ,  G06T2219/2012 ,  G06T2219/2016

Abstract: Methods and devices for processing image data for scene completion, including receiving an original image from an original viewpoint corresponding to a first direction, wherein the original image includes an object; obtaining a first image from a new viewpoint corresponding to a second direction different from the first direction by rotating the original image based on 3-dimensional (3D) information generated from 2-dimensional (2D) information which is obtained from the original image; determining an area within the first image for generating a second surface of the object based on depth information about a depth between the object and the background of the original image, wherein the determined area is expected to include an object area; and obtaining a second image by inputting the first image and the determined area to an artificial intelligence (AI) inpainting model, wherein the AI inpainting model generates the second surface of the object which occupies a portion of the determined area in the second image.

公开(公告)号：US20240286283A1

公开(公告)日：2024-08-29

申请号：US18114834

申请日：2023-02-27

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Jungseok HONG ,  Suveer GARG ,  Jinwook HUH ,  Hyun Soo PARK ,  Ibrahim Volkan ISLER

IPC: B25J9/16 ,  G06T7/70 ,  G06V10/44 ,  G06V10/74

CPC classification number: B25J9/1664 ,  B25J9/1697 ,  G06T7/70 ,  G06V10/44 ,  G06V10/761 ,  G06T2207/30241

Abstract: An electronic device for manipulating a target object, including: a camera; a memory; and at least one processor configured to: obtain a first image of the target object, wherein the first image is captured by the camera, provide the first image and a target image to an artificial intelligence (AI) model to obtain relative pose information, based on the obtained relative pose information, generate a similarity value, and generate a control command based on the similarity value, wherein based on the similarity value being greater than a threshold value, the control command includes a movement command for moving a manipulator associated with the electronic device from a first position to a second position, and wherein based on the similarity value being less than or equal to the threshold value, the control command includes a manipulation command for manipulating the target object using the manipulator.

公开(公告)号：US20230136306A1

公开(公告)日：2023-05-04

申请号：US17978873

申请日：2022-11-01

Applicant: SAMSUNG ELECTRONICS CO., LTD. ,  The Trustees of the University of Pennsylvania

Inventor： Ziyun WANG ,  Fernando Cladera OJEDA ,  Anthony Robert BISULCO ,  Dae Won LEE ,  Camillo J. TAYLOR ,  Konstantinos DANIILIDIS ,  Ani HSIEH ,  Ibrahim Volkan ISLER

IPC: G06T7/20 ,  G06V10/82 ,  G06V20/40 ,  A63B65/12

Abstract: Provided is a method for predicting a location of a fast-moving object. The method includes receiving event information from an event camera, the event information corresponding to an event detected by the event camera, generating a Binary Event History Image (BEHI) based on the event information, providing the BEHI as an input to an event-based neural network, obtaining, as an output of the event-based neural network, a first predicted location of the fast-moving object, a normal distribution indicating prediction uncertainty of the predicted location, and a predicted time-to-collision (TTC). The method further includes estimating a second predicted location of the fast-moving object based on the first predicted location, the normal distribution, and the predicted TTC output by the event-based neural network, and actuating a mechanical catching device to be at the second predicted location.

公开(公告)号：US20210312189A1

公开(公告)日：2021-10-07

申请号：US17129018

申请日：2020-12-21

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Anthony Robert BISULCO ,  Fernando CLADERA OJEDA ,  Ibrahim Volkan ISLER ,  Daniel Dongyuel LEE

IPC: G06K9/00 ,  G06T9/00 ,  H04N7/18 ,  G06K9/62 ,  H04L12/26

Abstract: A detection system includes a filter and a detector. The filter receives input packets from one or more dynamic vision sensors (DVSs) deployed in an area. The filter reduces the bandwidth of the input packets to produce compressed data packets while maintaining good end-to-end detection capability. The compressed data packets are transmitted to a detector in a low bandwidth transmission. The detector may collect compressed data packets from many filters. The detector determines if an object of interest is represented in the information of the input packets. If an object of interest is present, the detector activates an alarm, sends a notification to a person associated with the area and/or stores an indication in a database.