公开(公告)号：US20240346722A1

公开(公告)日：2024-10-17

申请号：US18423226

申请日：2024-01-25

Applicant: POSTECH RESEARCH AND BUSINESS DEVELOPMENT FOUNDATION

Inventor： Taehyun OH ,  Hyunwoo HA ,  Sungbin KIM

IPC: G06T11/60 ,  G06V10/44

CPC classification number: G06T11/60 ,  G06V10/44

Abstract: There is provided a method for training an image generating model that generates an image from an audio. The method includes selecting at least one frame from a video including a plurality of frames based on a correlation between an audio and an image of each frame; extracting image information and audio information from each of the selected at least one frame; and training an audio feature vector extracting model that extracts an audio feature vector from the audio information, wherein the audio feature vector is aligned within an embedding space with an image feature vector extracted from the image information by a pre-trained image feature vector extracting model.

公开(公告)号：US20240281983A1

公开(公告)日：2024-08-22

申请号：US18292723

申请日：2022-11-23

Applicant: POSCO CO., LTD. ,  RESEARCH INSTITUTE OF INDUSTRIAL SCIENCE & TECHNOLOGY ,  POSTECH Research and Business Development Foundation

Inventor： Tae Hyun OH ,  Hyunwoo HA ,  Sang Hyeok PARK ,  Laekyoung LEE ,  Jun Young SEO

IPC: G06T7/246 ,  G06T3/4007 ,  G06T3/60 ,  G06T7/13 ,  G06V10/25 ,  G06V10/44

CPC classification number: G06T7/246 ,  G06T3/4007 ,  G06T3/60 ,  G06T7/13 ,  G06V10/25 ,  G06V10/44

Abstract: A method of analyzing a motion on the basis of feature tracking is disclosed. The method includes the steps of: capturing image frames; filtering a region of interest (ROI) for the captured image frames; tracking a feature in the captured image frames; removing an extreme value on the basis of an optimum model; and outputting an analysis result.
Further disclosed is a system of analyzing a motion on the basis of feature tracking, the system comprising a controller configured to perform each step of the method.