公开(公告)号：US20240127627A1

公开(公告)日：2024-04-18

申请号：US18379020

申请日：2023-10-11

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Byung-Ok HAN ,  Ho-Won KIM ,  Jang-Hee YOO ,  Cheol-Hwan YOO ,  Jae-Yoon JANG

IPC: G06V40/16 ,  G06V10/82

CPC classification number: G06V40/176 ,  G06V10/82 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172

Abstract: Disclosed herein is an apparatus and method for detecting an emotional change through facial expression analysis. The apparatus for detecting an emotional change through facial expression analysis includes a memory having at least one program recorded thereon, and a processor configured to execute the program, wherein the program includes a camera image acquisition unit configured to acquire a moving image including at least one person, a preprocessing unit configured to extract a face image of a user from the moving image and preprocess the extracted face image, a facial expression analysis unit configured to extract a facial expression vector from the face image of the user and cumulatively store the facial expression vector, and an emotional change analysis unit configured to detect a temporal location of a sudden emotional change by analyzing an emotion signal extracted based on cumulatively stored facial expression vector values.

公开(公告)号：US20230071037A1

公开(公告)日：2023-03-09

申请号：US17558104

申请日：2021-12-21

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Ho-Won KIM ,  Cheol-Hwan YOO ,  Jang-Hee YOO ,  Jae-Yoon JANG

IPC: G06F3/01 ,  G06F3/0482

Abstract: Disclosed herein are an apparatus for recognizing a user command using non-contact gaze-based head motion information and a method using the same. The method includes monitoring the gaze and the head motion of a user based on a sensor, displaying a user interface at a location corresponding to the gaze based on gaze-based head motion information acquired by combining the gaze and the head motion, and recognizing a user command selected from the user interface.

公开(公告)号：US20250078568A1

公开(公告)日：2025-03-06

申请号：US18502336

申请日：2023-11-06

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Byung-Ok HAN ,  Moon-Ki BACK ,  Jang-Hee YOO ,  Cheol-Hwan YOO

IPC: G06V40/16

Abstract: Disclosed herein are an emotion recognition method and method based on context information. The emotion recognition method includes detecting information corresponding to an emotion recognition subject from an input image, extracting a recognition subject feature based on the information corresponding to the emotion recognition subject, extracting a context feature based on the input image, storing the recognition subject feature and the context feature in a short-term memory, and storing the context feature in a long-term memory.

公开(公告)号：US20240407685A1

公开(公告)日：2024-12-12

申请号：US18623224

申请日：2024-04-01

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Byung-Ok HAN ,  Moon-Ki BACK ,  Jang-Hee YOO ,  Cheol-Hwan YOO

IPC: A61B5/16 ,  A61B5/00 ,  G06V10/70 ,  G06V10/80 ,  G06V20/40 ,  G06V40/16 ,  G06V40/18 ,  G06V40/20 ,  G10L17/02 ,  G10L25/57 ,  G10L25/66 ,  G16H50/20

Abstract: Disclosed herein is a method for supporting Autism Spectrum Disorder (ASD) diagnosis based Artificial Intelligence (AI). The method includes extracting a detection area and voice corresponding to an inspector from an input video, extracting a detection area and voice corresponding to an assessment subject from the input video, extracting a feature of the inspector and a feature of the assessment subject, and extracting an interaction feature using the feature of the inspector and the feature of the assessment subject.

公开(公告)号：US20250125049A1

公开(公告)日：2025-04-17

申请号：US18795543

申请日：2024-08-06

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Cheol-Hwan YOO ,  Moon-Ki BACK ,  Jang-Hee YOO ,  Byung-Ok HAN

IPC: G16H50/20 ,  G16H30/40

Abstract: Disclosed herein is a method for assisting in Autism Spectrum Disorder (ASD) diagnosis. The method includes transmitting social-interaction-inducing content, receiving input images containing a response of an assessment subject to the social-interaction-inducing content, receiving an ASD diagnosis result for a preset number of input images, among the received input images, and outputting a diagnostic assistive result for the received input images using ASD diagnosis input for the preset number of input images and a pretrained global ASD diagnosis model.

公开(公告)号：US20240415413A1

公开(公告)日：2024-12-19

申请号：US18660379

申请日：2024-05-10

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Cheol-Hwan YOO ,  Moon-Ki BACK ,  Jang-Hee YOO ,  Byung-Ok HAN

IPC: A61B5/11

Abstract: Disclosed herein is a method for stereotyped behavior detection for supporting diagnosis of Autism Spectrum Disorder (ASD). The method includes detecting a target object to be assessed in an input video, detecting a section in which a periodic behavior occurs using an image sequence of the target object, and classifying a stereotyped behavior in the section in which the periodic behavior occurs.

公开(公告)号：US20250124598A1

公开(公告)日：2025-04-17

申请号：US18795557

申请日：2024-08-06

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Moon-Ki BACK ,  Jang-Hee YOO ,  Cheol-Hwan YOO ,  Byung-Ok HAN

IPC: G06T7/73 ,  G06V10/776 ,  G06V10/82

Abstract: Disclosed herein are a deep neural network (DNN) learning method for generalizing appearance-based gaze estimation and an apparatus for the same. The deep neural network (DNN) learning method includes creating multiple augmented images based on an original image, inputting the multiple augmented images to a DNN to output a gaze estimation value, calculating a total loss between a gaze ground truth of the original image and the gaze estimation value through gaze consistency regularization (GCR) using a spherical gaze distance (SGD), and updating parameters of the DNN by backpropagation of the total loss.

公开(公告)号：US20250114021A1

公开(公告)日：2025-04-10

申请号：US18898038

申请日：2024-09-26

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jang-Hee YOO ,  Cheol-Hwan YOO ,  Jae-Yoon JANG ,  Byung-Ok HAN

IPC: A61B5/16 ,  A61B5/00 ,  G06T7/00

Abstract: Disclosed herein are an interaction-based artificial intelligence analysis apparatus and method. The interaction-based artificial intelligence analysis apparatus is configured to output structured video content for each evaluation index so as to elicit an interaction to an examinee at each stimulus time-frame of a preset timeline, collect response data of the examinee for each evaluation index through a camera and a microphone at each response time-frame of the preset timeline, and analyze the response data for each evaluation index using an Artificial Intelligence (AI) analysis module corresponding to the evaluation index.