公开(公告)号：US09449229B1

公开(公告)日：2016-09-20

申请号：US14738034

申请日：2015-06-12

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Wei Hua ,  Rizwan Ahmed Chaudhry ,  Srivatsan Varadharajan ,  George Alban Heitz, III

IPC: G06K9/00 ,  G08B13/196 ,  H04N7/18 ,  G06K9/62 ,  G06T7/20 ,  H04N5/14

CPC classification number: G06K9/00718 ,  G06F3/0482 ,  G06F3/04847 ,  G06F3/04855 ,  G06F3/04886 ,  G06K9/00765 ,  G06K9/00771 ,  G06K9/6267 ,  G06K2009/00738 ,  G06T7/20 ,  G08B13/19604 ,  G08B13/19606 ,  G08B13/19608 ,  G08B13/19669 ,  G08B13/19684 ,  G11B27/3027 ,  G11B27/34 ,  H04N5/144 ,  H04N5/77 ,  H04N7/18 ,  H04N9/8205 ,  H04N21/4334 ,  H04N21/4335 ,  H04N21/44008 ,  H04N21/8133 ,  H04W4/80

Abstract: The various embodiments described herein include methods, devices, and systems for categorizing motion event candidates. In one aspect, a method includes receiving and processing video frames that include a motion event candidate. The processing includes: (a) obtaining background factors corresponding to a background in at least a subset of the video frames; (b) utilizing the background factors to identify one or more motion entities; (c) for each motion entity, obtaining one or more representative motion vectors based on a motion track of the respective motion entity; (d) identifying one or more features in at least a subset of the video frames; and (e) aggregating the background factors, the representative motion vectors, and the features to generate motion features. The method further includes sending the motion features to an event categorizer, where the event categorizer assigns a motion event category to the motion event candidate based on the received motion features.

Abstract translation: 本文描述的各种实施例包括用于对运动事件候选进行分类的方法，装置和系统。 一方面，一种方法包括接收和处理包括运动事件候选的视频帧。 该处理包括：（a）获得与视频帧的至少一个子集中的背景对应的背景因子; （b）利用背景因素来识别一个或多个运动实体; （c）对于每个运动实体，基于相应运动实体的运动轨迹获得一个或多个代表运动矢量; （d）识别视频帧的至少一个子集中的一个或多个特征; 和（e）聚集背景因子，代表运动矢量和特征以产生运动特征。 该方法还包括将运动特征发送到事件分类器，其中事件分类器基于所接收的运动特征向运动事件候选者分配运动事件类别。

公开(公告)号：US20150120733A1

公开(公告)日：2015-04-30

申请号：US14194518

申请日：2014-02-28

Applicant: Google Inc.

Inventor： Rodrigo Carceroni ,  Pannag Raghunath Sanketi ,  Marius Renn ,  Ruei-sung Lin ,  Wei Hua

IPC: G06F17/30

CPC classification number: G06F17/30843

Abstract: The disclosed technology includes techniques for improved content coverage in automatically-generated content summaries. The technique may include clustering a set of input content, determining diffusion for each cluster, and selecting representatives of each cluster to optimize other secondary metrics. Various types of input content may be used, including groups of images, video clips, or other multimedia content. Contiguous content may be manually or programmatically divided into discrete portions before clustering, for example, a lengthy video divided into a number of short clips. In some implementations, the disclosed technique may be implemented effectively on a mobile device. In other words, the processing required may be computationally feasible for execution on a smartphone or similar device.

Abstract translation: 所公开的技术包括用于改进自动生成的内容摘要中的内容覆盖的技术。 该技术可以包括对一组输入内容进行聚类，确定每个集群的扩散，以及选择每个集群的代表以优化其他次要度量。 可以使用各种类型的输入内容，包括图像组，视频剪辑或其他多媒体内容。 连续的内容可以在聚类之前被手动地或者编程地划分成离散的部分，例如，被分成多个短片段的冗长的视频。 在一些实现中，可以在移动设备上有效地实现所公开的技术。 换句话说，所需的处理在计算上可以在智能电话或类似设备上执行。

公开(公告)号：US20150117707A1

公开(公告)日：2015-04-30

申请号：US14228273

申请日：2014-03-28

Applicant: Google Inc.

Inventor： Rodrigo Lima Carceroni ,  Pannag Raghunath Sanketi ,  Marius Renn ,  Ruei-Sung Lin ,  Wei Hua

IPC: G06T7/20

CPC classification number: G06T7/2006 ,  G06T7/215 ,  G06T2207/10016 ,  G06T2207/20021

Abstract: Techniques for determining motion saliency in video content using center-surround receptive fields. In some implementations, images or frames from a video may be apportioned into non-overlapped regions, for example, by applying a rectilinear grid. For each grid region, or cell, motion consistency may be measured between the center and surround area of that cell across frames of the video. Consistent motion across the center-surround area may indicate that the corresponding region has low variation. The larger the difference between center-surround motions in a cell, the more likely the region has high motion saliency.

Abstract translation: 用于使用中心环绕接收场来确定视频内容中的运动显着性的技术。 在一些实现中，来自视频的图像或帧可以例如通过应用直线网格而被分配到非重叠区域中。 对于每个网格区域或单元格，可以在视频的帧之间的该单元的中心区域和环绕区域之间测量运动一致性。 穿过中心环绕区域的一致运动可以指示对应的区域具有低的变化。 细胞中心环绕运动之间的差异越大，该区域的运动显着性就越高。