公开(公告)号：US11544524B2

公开(公告)日：2023-01-03

申请号：US16460617

申请日：2019-07-02

Applicant: SAMSUNG ELECTRONICS CO., LTD.

Inventor： Chanwon Seo ,  Lei Zhang ,  Yehoon Kim ,  Sojung Yun ,  Dongwan Lee ,  Yongsung Kim ,  Juyoung Lee

IPC: G10L25/63 ,  G06N3/04 ,  G06N3/08 ,  G06V40/16

Abstract: Emotion information is obtained by an electronic device in order to improve communication between a person and the electronic device. Multimedia data is obtained regarding a person, predicted values for the person are obtained by applying the multimedia data to neural network models, and emotion information of the person is obtained by applying the predicted values to a weight model. Then, feedback information is obtained from the person with respect to the first emotion information of the person. Finally, the weight model is updated by using the feedback information. Subsequently, when multimedia data are again obtained regarding the person, new predicted values for the person are obtained by applying later multimedia data the plurality of neural network models, and emotion information of the person is again obtained, but this time using the weight model updated using the feedback information.

公开(公告)号：US11514650B2

公开(公告)日：2022-11-29

申请号：US17080296

申请日：2020-10-26

Applicant: Samsung Electronics Co., Ltd.

Inventor： Yongsung Kim ,  Daehyun Ban ,  Dongwan Lee ,  Hongpyo Lee ,  Lei Zhang

IPC: G06T19/00 ,  G06K9/00 ,  G06T7/50 ,  G06K9/62 ,  G06T7/70 ,  G06N3/08 ,  G06V40/10

Abstract: An electronic apparatus is provided. The electronic apparatus includes a display, a camera configured to capture a rear of the electronic apparatus facing a front of the electronic apparatus in which the display displays an image, and a processor configured to render a virtual object based on the image captured by the camera, based on a user body being detected from the captured image, estimate a plurality of joint coordinates with respect to the detected user body using a pre-trained learning model, generate an augmented reality image using the estimated plurality of joint coordinates, the rendered virtual object, and the captured image, and control the display to display the generated augmented reality image, wherein the processor is configured to identify whether the user body touches the virtual object based on the plurality of estimated joint coordinates, and change a transmittance of the virtual object based on the touch being identified.