公开(公告)号：US20220261550A1

公开(公告)日：2022-08-18

申请号：US17398554

申请日：2021-08-10

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Jin-Young MOON ,  Jung-Kyoo SHIN ,  Hyung-Il KIM

IPC: G06F40/30 ,  G06K9/00 ,  G06F40/205 ,  G06K9/62

Abstract: Disclosed herein are an apparatus for detecting a moment described by a sentence query in a video and a method using the same. A method for detecting a moment described by a sentence query in a video includes dividing an input video into units of chunks and generating a chunk-level feature sequence based on features that are extracted in a form of vectors from respective chunks, dividing an input sentence query into units of words and generating a sentence-level feature sequence based on features that are extracted in a form of vectors from respective words, generating a chunk-sentence relation feature sequence including contextual information of the video by extracting a relation between the chunk-level feature sequence and the sentence-level feature sequence, and estimating a temporal interval corresponding to the sentence query in the video based on the chunk-sentence relation feature sequence.