公开(公告)号：US11334376B2

公开(公告)日：2022-05-17

申请号：US16184601

申请日：2018-11-08

Applicant: Samsung Electronics Co., Ltd

Inventor： Jihee Kim ,  Abhijit Bendale ,  Zhihan Ying ,  Simon Gibbs ,  Lu Luo

IPC: G06K9/00 ,  G06F9/451 ,  G06F3/0481 ,  G06F3/01 ,  H04M1/72436

Abstract: A computer-implemented method of providing an emotion-aware reactive interface in an electronic device includes receiving an image of a user as an input and identifying a multi-modal non-verbal cue in the image. The method further includes interpreting the multi-modal non-verbal cue to determine a categorization and outputting a reactive interface event determined based on the categorization.

公开(公告)号：US10909371B2

公开(公告)日：2021-02-02

申请号：US15841157

申请日：2017-12-13

Applicant: Samsung Electronics Co., Ltd.

Inventor： Stanislaw Antol ,  Abhijit Bendale ,  Simon J. Gibbs ,  Won J. Jeon ,  Hyun Jae Kang ,  Jihee Kim ,  Bo Li ,  Anthony S. Liot ,  Lu Luo ,  Pranav K. Mistry ,  Zhihan Ying

IPC: G06K9/00 ,  G06N20/00 ,  G06F11/30 ,  G06F11/34 ,  G06K9/32 ,  G06K9/62 ,  G06K9/66 ,  G06N3/08 ,  G06N5/02 ,  G06T11/00 ,  G06T19/00 ,  H04L29/08 ,  H04L29/06 ,  G06F3/14

Abstract: A method includes retrieving, by a device, contextual information based on at least one of an image, the device, user context, or a combination thereof. At least one model is identified from multiple models based on the contextual information and at least one object recognized in an image based on at least one model. At least one icon is displayed at the device. The at least one icon being associated with at least one of an application, a service, or a combination thereof providing additional information.

公开(公告)号：US10812711B2

公开(公告)日：2020-10-20

申请号：US16415860

申请日：2019-05-17

Applicant: Samsung Electronics Co., Ltd.

Inventor： Michael Sapienza ,  Ankur Gupta ,  Abhijit Bendale ,  Fannie Fontanel

IPC: H04N5/232 ,  H04N5/343 ,  G02B27/01 ,  H04N5/357 ,  H04N5/374 ,  G06T7/11 ,  G06K9/62 ,  G06T15/00 ,  G06T15/10 ,  G06T19/00

Abstract: An apparatus includes a dynamic vision sensor (DVS) configured to output an asynchronous stream of sensor event data, a CMOS image sensor configured to output frames of image data, an inertial measurement unit (IMU), a processor and a memory. The memory contains instructions, which when executed by the processor, cause the apparatus to generate a semantic segmentation of a time-stamped frame, which is based on one or more of an output of the CMOS image sensor, or a synthesized event frame based on an output from the DVS and an output from the IMU over a time interval. The semantic segmentation includes a semantic label associated with a region of the time-stamped frame. When executed, the instructions further cause the apparatus to determine, based on the semantic segmentation, a simplified object representation in a coordinate space, and update a stable semantic map based on the simplified object representation.

公开(公告)号：US20180204061A1

公开(公告)日：2018-07-19

申请号：US15875393

申请日：2018-01-19

Applicant: Samsung Electronics Co., Ltd.

Inventor： Stanislaw Antol ,  Abhijit Bendale ,  Simon J. Gibbs ,  Won J. Jeon ,  Hyun Jae Kang ,  Jihee Kim ,  Bo Li ,  Anthony S. Liot ,  Lu Luo ,  Pranav K. Mistry ,  Zhihan Ying

IPC: G06K9/00 ,  G06K9/66 ,  G06K9/62 ,  G06F11/34 ,  G06K9/32

Abstract: One embodiment provides a method comprising classifying one or more objects present in an input comprising visual data by executing a first set of models associated with a domain on the input. Each model corresponds to an object category. Each model is trained to generate a visual classifier result relating to a corresponding object category in the input with an associated confidence value indicative of accuracy of the visual classifier result. The method further comprises aggregating a first set of visual classifier results based on confidence value associated with each visual classifier result of each model of the first set of models. At least one other model is selectable for execution on the input based on the aggregated first set of visual classifier results for additional classification of the objects. One or more visual classifier results are returned to an application running on an electronic device for display.