公开(公告)号：US09627004B1

公开(公告)日：2017-04-18

申请号：US14883461

申请日：2015-10-14

Applicant: Google Inc.

Inventor： Balakrishnan Varadarajan ,  Sanketh Shetty ,  Apostol Natsev ,  Nitin Khandelwal ,  Weilong Yang ,  Sudheendra Vijayanarasimhan ,  WeiHsin Gu ,  Nicola Muscettola

IPC: H04N9/80 ,  H04N5/77 ,  G11B27/10 ,  G06K9/00 ,  G06K9/46 ,  G06F17/30 ,  G06F17/24 ,  H04N21/2743 ,  H04N21/234 ,  H04N21/235

CPC classification number: G11B27/10 ,  G06F17/241 ,  G06F17/30799 ,  G06F17/3082 ,  G06K9/00744 ,  G06K9/6259 ,  G06K9/6277 ,  G06K2209/27 ,  H04N21/23418 ,  H04N21/251 ,  H04N21/278 ,  H04N21/4828 ,  H04N21/84 ,  H04N21/8456

Abstract: A system and methodology provide for annotating videos with entities and associated probabilities of existence of the entities within video frames. A computer-implemented method selects an entity from a plurality of entities identifying characteristics of a video item, where the video item has associated metadata. The computer-implemented method receives probabilities of existence of the entity in video frames of the video item, and selects a video frame determined to comprise the entity responsive to determining the video frame having a probability of existence of the entity greater than zero. The computer-implemented method determines a scaling factor for the probability of existence of the entity using the metadata of the video item, and determines an adjusted probability of existence of the entity by using the scaling factor to adjust the probability of existence of the entity. The computer-implemented method labels the video frame with the adjusted probability of existence.

公开(公告)号：US20160070962A1

公开(公告)日：2016-03-10

申请号：US14848216

申请日：2015-09-08

Applicant: Google Inc.

Inventor： Sanketh Shetty ,  Tomas Izo ,  Min-Hsuan Tsai ,  Sudheendra Vijayanarasimhan ,  Apostol Natsev ,  Sami Abu-El-Haija ,  George Dan Toderici ,  Susanna Ricco ,  Balakrishnan Varadarajan ,  Nicola Muscettola ,  WeiHsin Gu ,  Weilong Yang ,  Nitin Khandelwal ,  Phuong Le

IPC: G06K9/00 ,  G06F17/30

CPC classification number: G06K9/00718 ,  G06F17/30787 ,  G06K9/00744 ,  G06K9/00751 ,  G06K9/00765 ,  G06K2209/27

Abstract: A computer-implemented method for selecting representative frames for videos is provided. The method includes receiving a video and identifying a set of features for each of the frames of the video. The features including frame-based features and semantic features. The semantic features identifying likelihoods of semantic concepts being present as content in the frames of the video. A set of video segments for the video is subsequently generated. Each video segment includes a chronological subset of frames from the video and each frame is associated with at least one of the semantic features. The method generates a score for each frame of the subset of frames for each video segment based at least on the semantic features, and selecting a representative frame for each video segment based on the scores of the frames in the video segment. The representative frame represents and summarizes the video segment.

Abstract translation: 提供了一种用于选择视频的代表性帧的计算机实现的方法。 该方法包括接收视频并识别视频的每个帧的一组特征。 特征包括基于帧的特征和语义特征。 识别语义概念的可能性的语义特征作为视频帧中的内容呈现。 随后生成视频的一组视频段。 每个视频段包括来自视频的帧的按时间顺序的子集，并且每个帧与语义特征中的至少一个相关联。 该方法至少基于语义特征为每个视频段的帧子集的每帧生成分数，并且基于视频段中的帧的分数为每个视频段选择代表性的帧。 代表性的框架代表和总结视频段。