公开(公告)号：US20230368499A1

公开(公告)日：2023-11-16

申请号：US18318159

申请日：2023-05-16

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Young Wan LEE ,  Jong Hee KIM ,  Jin Young MOON ,  Kang Min BAE ,  Yu Seok BAE ,  Je Seok HAM

IPC: G06V10/77 ,  G06V10/82 ,  G06V10/74 ,  G06V10/42

CPC classification number: G06V10/7715 ,  G06V10/82 ,  G06V10/761 ,  G06V10/42

Abstract: The disclosure relates to a method of extracting image features based on a vision transformer, a method of performing embedding on an input image in units of patches and extracting visual features through global attention. An apparatus for extracting an image feature based on a vision transformer according to an embodiment of the disclosure includes a memory configured to store data and a processor configured to control the memory, wherein the processor is configured to perform embedding on multi-patches for an input image, extract feature maps for the embedding multi-patches, perform transformer encoding based on a neural network using the extracted feature maps, extract a feature of the input image through a final feature map extracted through the transformer encoding, and wherein the patches have different sizes.

公开(公告)号：US20210142063A1

公开(公告)日：2021-05-13

申请号：US17088185

申请日：2020-11-03

Applicant: Electronics and Telecommunications Research Institute

Inventor： Jin Young MOON ,  Yong Jin KWON ,  Hyung Il KIM ,  Jong Youl PARK ,  Kang Min BAE ,  Ki Min YUN

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/20

Abstract: An electronic device according to an embodiment disclosed herein may include a memory including at least one instruction and a processor. By executing the at least one instruction, the processor may check feature information corresponding to a video and including at least one of an appearance-related feature value and a motion-related feature value from the video, calculate at least one of a starting score related to a starting point of an action instance, an ending score related to an ending point of an action instance, and a relatedness score between action instances on the basis of the feature information corresponding to the video, the action instances being included in the video, and generate an action proposal included in the video on the basis of the at least one score.

公开(公告)号：US20220129689A1

公开(公告)日：2022-04-28

申请号：US17513441

申请日：2021-10-28

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Hyungil KIM ,  Kimin YUN ,  Yongjin KWON ,  Jin Young MOON ,  Jongyoul PARK ,  Kang Min BAE ,  Sungchan OH ,  Youngwan LEE

IPC: G06K9/32 ,  G06K9/00 ,  G06K9/62 ,  G06N3/08

Abstract: A method and apparatus for face recognition robust to an alignment of the face comprising: estimating prior information of a facial shape from an input image cropped from an image including a face using the first deep neural network (DNN); extracting feature information of facial appearance from the input image by using a second DNN; training, by using a face image decoder based on the prior information and the feature information, the face recognition apparatus; and extracting, from a test image, facial shape-aware features in the inference step by using the trained second DNN.

公开(公告)号：US20230386252A1

公开(公告)日：2023-11-30

申请号：US18313152

申请日：2023-05-05

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Hyungil KIM ,  Minho PARK ,  Kang Min BAE

IPC: G06V40/16 ,  G06V10/98 ,  G06V10/80 ,  G06V10/82

CPC classification number: G06V40/171 ,  G06V10/993 ,  G06V10/806 ,  G06V10/82

Abstract: The present disclosure relates to a low-resolution face recognition device, which includes a high-resolution face image inputter; a low-resolution face image inputter; a high-resolution face feature extractor configured to extract a high-resolution face feature by using high-resolution and low-resolution face images; a face quality feature extractor configured to extract face quality features by using the high-resolution and low-resolution face images; a feature combiner configured to detect the high-resolution and low-resolution face features by concatenating the high-resolution face feature and the face quality feature; a feature adaptation network configured to extract a high-resolution face feature map and a low-resolution face feature map by using the detected high-resolution and low-resolution face features, respectively; and a consistency meter configured to determine a face ID by measuring consistency of a face feature map by using the extracted high-resolution and low-resolution face feature maps.

公开(公告)号：US20220067382A1

公开(公告)日：2022-03-03

申请号：US17411728

申请日：2021-08-25

Applicant: Electronics and Telecommunications Research Institute

Inventor： Jin Young MOON ,  Hyung Il KIM ,  Jong Youl PARK ,  Kang Min BAE ,  Ki Min YUN

IPC: G06K9/00

Abstract: Provided is an apparatus for online action detection, the apparatus including a feature extraction unit configured to extract a chunk-level feature of a video chunk sequence of a streaming video, a filtering unit configured to perform filtering on the chunk-level feature, and an action classification unit configured to classify an action class using the filtered chunk-level feature.