公开(公告)号：US20240193797A1

公开(公告)日：2024-06-13

申请号：US18531940

申请日：2023-12-07

Applicant: Korea Electronics Technology Institute

Inventor： Bo Eun KIM ,  Jung Ho KIM ,  Sa Im SHIN

IPC: G06T7/262 ,  G06F17/16

CPC classification number: G06T7/262 ,  G06F17/16

Abstract: There are provided a method and a system for generating human motions, which generate motions of an empty frame by using motions in a given frame. A human motion generation method according to an embodiment includes: a first step of transforming, by a system, a domain of pose information of a frame; a second step of generating, by the system, motion features of an empty frame in the transformed domain; and a third step of inversely transforming, by the system, the generated motion features into a time domain. Accordingly, the method and system may effectively generate motions by obtaining a basis vector to be used for transforming a domain of motion trajectory information by training a deep learning-based transform model, transforming a motion trajectory through the basis vector, and inputting the transformed motion trajectory to a motion generation model.

公开(公告)号：US20240096071A1

公开(公告)日：2024-03-21

申请号：US18368600

申请日：2023-09-15

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Sa Im SHIN ,  Jung Ho KIM ,  Bo Eun KIM

IPC: G06V10/774 ,  G06T7/246 ,  G06V10/20 ,  G06V10/82 ,  G06V10/94 ,  G06V20/40 ,  G06V40/20

CPC classification number: G06V10/7747 ,  G06T7/251 ,  G06V10/255 ,  G06V10/82 ,  G06V10/95 ,  G06V20/46 ,  G06V40/23 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30196

Abstract: There is provided a video processing method performed by a computing device, the method including the steps of: collecting video from an external device; generating preprocessed data by extracting two-dimensional or three-dimensional skeleton information from the video; pre-training a first artificial intelligence model including N transformer blocks from the preprocessed data by applying an attention from a body of an object to a plurality of joints, an attention from each of the plurality of joints to the body, and an attention between persons; and learning, when parameters determined as a result of the pre-training of the first artificial intelligence model are transferred, a method of recognizing an action from the video received from the external device, using a second artificial intelligence model including the N transformer blocks on the basis of the parameters, wherein N is a natural number equal to or larger than 2.