公开(公告)号：EP3366043A1

公开(公告)日：2018-08-29

申请号：EP16787973.3

申请日：2016-10-13

申请人： Microsoft Technology Licensing, LLC

发明人： YAO, Ting ,  MEI, Tao ,  RUI, Yong

IPC分类号： H04N21/8549 ,  H04N21/4545 ,  H04N21/466

CPC分类号： G06K9/00718 ,  G06K9/00751 ,  G11B27/031 ,  G11B27/3081 ,  H04N21/45457 ,  H04N21/4666 ,  H04N21/8549

摘要： Video highlight detection using pairwise deep ranking neural network training is described. In some examples, highlights in a video are discovered, then used for generating summarization of videos, such as first-person videos. A pairwise deep ranking model is employed to learn the relationship between previously identified highlight and non-highlight video segments. This relationship is encapsulated in a neural network. An example two stream process generates highlight scores for each segment of a user's video. The obtained highlight scores are used to summarize highlights of the user's video.