公开(公告)号：USD893508S1

公开(公告)日：2020-08-18

申请号：US29593971

申请日：2017-02-14

Applicant: GOOGLE INC.

Designer： Jason N. Laska ,  Melissa McLean

公开(公告)号：US20170270365A1

公开(公告)日：2017-09-21

申请号：US15613013

申请日：2017-06-02

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Wei Hua ,  Prateek Reddy ,  Akshay R. Bapat ,  Lawrence W. Neal

IPC: G06K9/00 ,  H04N7/18 ,  H04N5/14 ,  G06F3/0488 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/0485 ,  G06K9/32 ,  G11B27/00 ,  G11B27/028 ,  G11B27/031 ,  G11B27/10 ,  G11B27/30 ,  G11B27/34 ,  H04N5/93 ,  G08B13/196 ,  G06K9/62

CPC classification number: G06K9/00771 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04847 ,  G06F3/0485 ,  G06F3/04855 ,  G06F3/0488 ,  G06F3/04883 ,  G06K9/00288 ,  G06K9/00335 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00765 ,  G06K9/3241 ,  G06K9/6226 ,  G06K9/6227 ,  G06K9/6267 ,  G06K2009/00738 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30232 ,  G08B13/196 ,  G08B13/19608 ,  G08B13/19613 ,  G08B13/19615 ,  G08B13/19682 ,  G08B13/19691 ,  G11B27/005 ,  G11B27/028 ,  G11B27/031 ,  G11B27/105 ,  G11B27/28 ,  G11B27/30 ,  G11B27/34 ,  H04L12/2803 ,  H04N5/144 ,  H04N5/145 ,  H04N5/93 ,  H04N7/18 ,  H04N7/181 ,  H04N7/183 ,  H04N21/23418 ,  H04N21/42204 ,  H04N21/4314 ,  H04N21/6581 ,  H04N21/8456 ,  H04W4/80

Abstract: The various embodiments described herein include methods, devices, and systems for categorizing motion events. In one aspect, a method is performed at a camera device. The method includes: (1) capturing a plurality of video frames via the image sensor, the plurality of video frames corresponding to a scene in a field of view of the camera; (2) sending the video frames to the remote server system in real-time; (3) while sending the video frames to the remote server system in real-time: (a) determining that motion has occurred within the scene; (b) in response to determining that motion has occurred within the scene, characterizing the motion as a motion event; and (c) generating motion event metadata for the motion event; and (4) sending the generated motion event metadata to the remote server system concurrently with the video frames.

公开(公告)号：US09674570B2

公开(公告)日：2017-06-06

申请号：US15203557

申请日：2016-07-06

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Greg R. Nelson ,  Greg Duffy

IPC: H04N21/431 ,  H04N21/4335 ,  H04N21/433 ,  G11B27/00 ,  G11B27/34 ,  G06T7/20 ,  G08B13/196 ,  G06K9/00 ,  H04N7/18

CPC classification number: G06K9/00765 ,  G06F3/048 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04847 ,  G06F3/0485 ,  G06F3/04855 ,  G06F3/0488 ,  G06F3/04883 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00771 ,  G06K9/3241 ,  G06K2009/00738 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30232 ,  G08B13/19613 ,  G08B13/19615 ,  G08B13/19682 ,  G08B13/19684 ,  G11B27/005 ,  G11B27/028 ,  G11B27/031 ,  G11B27/105 ,  G11B27/30 ,  G11B27/34 ,  H04L9/0822 ,  H04L9/085 ,  H04L9/0869 ,  H04L63/0428 ,  H04L63/083 ,  H04L67/10 ,  H04L2209/80 ,  H04L2463/062 ,  H04N5/144 ,  H04N5/93 ,  H04N7/18 ,  H04N7/183 ,  H04N7/185 ,  H04N9/87 ,  H04N21/2187 ,  H04N21/2347 ,  H04N21/239 ,  H04N21/2393 ,  H04N21/2541 ,  H04N21/2743 ,  H04N21/42204 ,  H04N21/4222 ,  H04N21/431 ,  H04N21/4312 ,  H04N21/4314 ,  H04N21/4316 ,  H04N21/4334 ,  H04N21/4335 ,  H04N21/4408 ,  H04N21/4622 ,  H04N21/4627 ,  H04N21/4753 ,  H04W4/80 ,  H04W12/02 ,  H04W12/04 ,  H04W12/06 ,  H04W12/08 ,  H04W84/12

Abstract: A computing system device with processor(s) and memory displays a video monitoring user interface on the display. The video monitoring user interface includes a first region for displaying a live video feed and/or a recorded video feed from the video camera and a second region for displaying a single event timeline. A current video feed indicator is movable on the timeline for indicating the temporal position of the video feed displayed in the first region. The temporal position includes a past time and a current time corresponding to the previously recorded video feed and the live video feed, respectively. While the current video feed indicator is moved to indicate the temporal position of the video feed displayed in the first region, video segments corresponding to the one or more events has a higher priority for display in the first region than video segments that do not contain any event.

公开(公告)号：US20170046574A1

公开(公告)日：2017-02-16

申请号：US15334172

申请日：2016-10-25

Applicant: Google Inc.

Inventor： Jason N. Laska ,  Wei Hua ,  Prateek Reddy ,  Akshay R. Bapat ,  Lawrence W. Neal

IPC: G06K9/00 ,  G06K9/32 ,  H04N7/18 ,  G08B13/196 ,  G06T7/20

CPC classification number: G06K9/00771 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04847 ,  G06F3/0485 ,  G06F3/04855 ,  G06F3/0488 ,  G06F3/04883 ,  G06K9/00288 ,  G06K9/00335 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00765 ,  G06K9/3241 ,  G06K9/6226 ,  G06K9/6227 ,  G06K9/6267 ,  G06K2009/00738 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30232 ,  G08B13/196 ,  G08B13/19608 ,  G08B13/19613 ,  G08B13/19615 ,  G08B13/19682 ,  G08B13/19691 ,  G11B27/005 ,  G11B27/028 ,  G11B27/031 ,  G11B27/105 ,  G11B27/30 ,  G11B27/34 ,  H04L12/2803 ,  H04N5/144 ,  H04N5/145 ,  H04N5/93 ,  H04N7/18 ,  H04N7/181 ,  H04N7/183 ,  H04N21/23418 ,  H04N21/42204 ,  H04N21/4314 ,  H04N21/6581 ,  H04N21/8456 ,  H04W4/80

Abstract: The various embodiments described herein include methods, devices, and systems for categorizing motion events. In one aspect, a method includes: (1) obtaining a plurality of video frames, the plurality of video frames corresponding to a scene and a motion event candidate; (2) identifying one or more visual characteristics of the scene; (3) obtaining one or more background factors for the scene; (4) utilizing the obtained background factors to identify one or more motion entities; (5) for each identified motion entity: (a) classifying the motion entity by performing object recognition; and (b) obtaining one or more representative motion vectors based on a motion track of the motion entity; and (6) assigning a motion event category to the motion event candidate based on the identified visual characteristics, the obtained background factors, the classified motion entities, and the obtained representative motion vectors.

Abstract translation: 本文描述的各种实施例包括用于对运动事件进行分类的方法，装置和系统。 一方面，一种方法包括：（1）获得多个视频帧，对应于场景的多个视频帧和运动事件候选; （2）识别场景的一个或多个视觉特征; （3）获取场景的一个或多个背景因子; （4）利用获得的背景因子来识别一个或多个运动实体; （5）对于每个识别的运动实体：（a）通过执行对象识别对运动实体进行分类; 和（b）基于运动实体的运动轨迹获得一个或多个代表运动矢量; 以及（6）基于所识别的视觉特征，所获得的背景因子，分类的运动实体和所获得的代表性运动矢量，将运动事件类别分配给运动事件候选。

公开(公告)号：US20160012609A1

公开(公告)日：2016-01-14

申请号：US14864584

申请日：2015-09-24

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Gregory R. Nelson ,  Greg Duffy ,  Hiro Mitsuji ,  Cameron Hill ,  Martin Davidsson ,  Michael D. Montalbo ,  Tung Yuen Wan

IPC: G06T7/20 ,  G06K9/00

CPC classification number: G06K9/00771 ,  G06F3/04842 ,  G06F3/0488 ,  G06K9/00288 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00744 ,  G06K9/00979 ,  G06K9/2081 ,  G06K9/6227 ,  G06K9/6267 ,  G06K9/6276 ,  G06K9/6279 ,  G06K9/628 ,  G06K2009/00738 ,  G06T7/20 ,  G06T7/246 ,  G06T2207/10016 ,  G08B13/19608 ,  H04N5/144 ,  H04N5/145 ,  H04N5/23203 ,  H04N5/23245 ,  H04N5/23293 ,  H04N5/23296 ,  H04N5/2628 ,  H04N7/18 ,  H04N7/181 ,  H04N21/2181 ,  H04N21/239 ,  H04N21/44231

Abstract: A computing system obtains a respective motion vector for each of a series of motion event candidates in real-time as said each motion event candidate is detected in a live video stream. In response to receiving the respective motion vector for each of the series of motion event candidates, the computing system determines a spatial relationship between the respective motion vector of said each motion event candidate to one or more existing clusters established based on a plurality of previously processed motion vectors, and in accordance with a determination that the respective motion vector of a first motion event candidate of the series of motion event candidates falls within a respective range of at least a first existing cluster of the one or more existing clusters, assigns the first motion event candidate to at least a first event category associated with the first existing cluster.

Abstract translation: 计算系统在实时视频流中检测到所述每个运动事件候选者时，实时获取一系列运动事件候选的每个运动矢量。 响应于接收到一系列运动事件候选中的每一个的相应运动矢量，计算系统确定所述每个运动事件候选者的相应运动矢量与基于多个先前处理的一个或多个现有集群之间的空间关系 运动矢量，并且根据确定所述一系列运动事件候选者的第一运动事件候选者的相应运动矢量落在所述一个或多个现有集群的至少第一现有集群的相应范围内，分配第一 运动事件候选者至少与第一现有集群相关联的第一事件类别。

公开(公告)号：US09213903B1

公开(公告)日：2015-12-15

申请号：US14510007

申请日：2014-10-08

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Gregory R. Nelson ,  Greg Duffy ,  Hiro Mitsuji ,  Cameron Hill ,  Martin Davidsson ,  Michael D. Montalbo ,  Tung Yuen Wan

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/20 ,  H04N5/14

CPC classification number: G06K9/00771 ,  G06F3/04842 ,  G06F3/0488 ,  G06K9/00288 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00744 ,  G06K9/00979 ,  G06K9/2081 ,  G06K9/6227 ,  G06K9/6267 ,  G06K9/6276 ,  G06K9/6279 ,  G06K9/628 ,  G06K2009/00738 ,  G06T7/20 ,  G06T7/246 ,  G06T2207/10016 ,  G08B13/19608 ,  H04N5/144 ,  H04N5/145 ,  H04N5/23203 ,  H04N5/23245 ,  H04N5/23293 ,  H04N5/23296 ,  H04N5/2628 ,  H04N7/18 ,  H04N7/181 ,  H04N21/2181 ,  H04N21/239 ,  H04N21/44231

Abstract: A computing system obtains a respective motion vector for each of a series of motion event candidates in real-time as said each motion event candidate is detected in a live video stream. In response to receiving the respective motion vector for each of the series of motion event candidates, the computing system determines a spatial relationship between the respective motion vector of said each motion event candidate to one or more existing clusters established based on a plurality of previously processed motion vectors, and in accordance with a determination that the respective motion vector of a first motion event candidate of the series of motion event candidates falls within a respective range of at least a first existing cluster of the one or more existing clusters, assigns the first motion event candidate to at least a first event category associated with the first existing cluster.

Abstract translation: 计算系统在实时视频流中检测到所述每个运动事件候选者时，实时获取一系列运动事件候选的每个运动矢量。 响应于接收到一系列运动事件候选中的每一个的相应运动矢量，计算系统确定所述每个运动事件候选者的相应运动矢量与基于多个先前处理的一个或多个现有集群之间的空间关系 运动矢量，并且根据确定所述一系列运动事件候选者的第一运动事件候选者的相应运动矢量落在所述一个或多个现有集群的至少第一现有集群的相应范围内，分配第一 运动事件候选者至少与第一现有集群相关联的第一事件类别。

公开(公告)号：US09170707B1

公开(公告)日：2015-10-27

申请号：US14510015

申请日：2014-10-08

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Greg R. Nelson ,  Greg Duffy ,  Hiro Mitsuji ,  Lawrence W. Neal ,  Cameron Hill

IPC: G06F3/00 ,  G06F3/0481 ,  G06F3/0484 ,  H04L29/08 ,  G11B27/00 ,  G11B27/028

CPC classification number: G06K9/00765 ,  G06F3/048 ,  G06F3/0481 ,  G06F3/0482 ,  G06F3/04842 ,  G06F3/04845 ,  G06F3/04847 ,  G06F3/0485 ,  G06F3/04855 ,  G06F3/0488 ,  G06F3/04883 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00771 ,  G06K9/3241 ,  G06K2009/00738 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/30232 ,  G08B13/19613 ,  G08B13/19615 ,  G08B13/19682 ,  G08B13/19684 ,  G11B27/005 ,  G11B27/028 ,  G11B27/031 ,  G11B27/105 ,  G11B27/30 ,  G11B27/34 ,  H04L9/0822 ,  H04L9/085 ,  H04L9/0869 ,  H04L63/0428 ,  H04L63/083 ,  H04L67/10 ,  H04L2209/80 ,  H04L2463/062 ,  H04N5/144 ,  H04N5/93 ,  H04N7/18 ,  H04N7/183 ,  H04N7/185 ,  H04N9/87 ,  H04N21/2187 ,  H04N21/2347 ,  H04N21/239 ,  H04N21/2393 ,  H04N21/2541 ,  H04N21/2743 ,  H04N21/42204 ,  H04N21/4222 ,  H04N21/431 ,  H04N21/4312 ,  H04N21/4314 ,  H04N21/4316 ,  H04N21/4334 ,  H04N21/4335 ,  H04N21/4408 ,  H04N21/4622 ,  H04N21/4627 ,  H04N21/4753 ,  H04W4/80 ,  H04W12/02 ,  H04W12/04 ,  H04W12/06 ,  H04W12/08 ,  H04W84/12

Abstract: An electronic device with a display, processor(s), and memory displays a video monitoring user interface including a video feed from a camera located remotely from the client device in a first region and an event timeline in a second region, the event timeline including event indicators for motion events previously detected by the camera. The electronic device detects a user input selecting a portion of the event timeline, where the selected portion of the event timeline includes a subset of the event indicators. In response to the user input, the electronic device causes generation of a time-lapse video clip of the selected portion of the event timeline. The electronic device displays the time-lapse video clip, where motion events corresponding to the subset of the event indicators are played at a slower speed than the remainder of the selected portion of the event timeline.

Abstract translation: 具有显示器，处理器和存储器的电子设备在第一区域和第二区域中的事件时间线上显示包括来自位于远离客户端设备的摄像机的视频馈送的视频监控用户界面，事件时间线包括 以前由相机检测到的运动事件的事件指示器。 电子设备检测选择事件时间线的一部分的用户输入，其中事件时间线的所选部分包括事件指示符的子集。 响应于用户输入，电子设备引起事件时间线的所选部分的延时视频剪辑的产生。 电子设备显示延时视频剪辑，其中与事件指示符的子集相对应的运动事件以比事件时间线的选定部分的剩余部分更慢的速度播放。

公开(公告)号：US09158974B1

公开(公告)日：2015-10-13

申请号：US14509999

申请日：2014-10-08

Applicant: GOOGLE INC.

Inventor： Jason N. Laska ,  Gregory R. Nelson ,  Greg Duffy

IPC: G06K9/00 ,  H04N5/14 ,  H04N21/239

CPC classification number: G06K9/00771 ,  G06F3/04842 ,  G06F3/0488 ,  G06K9/00288 ,  G06K9/00711 ,  G06K9/00718 ,  G06K9/00744 ,  G06K9/00979 ,  G06K9/2081 ,  G06K9/6227 ,  G06K9/6267 ,  G06K9/6276 ,  G06K9/6279 ,  G06K9/628 ,  G06K2009/00738 ,  G06T7/20 ,  G06T7/246 ,  G06T2207/10016 ,  G08B13/19608 ,  H04N5/144 ,  H04N5/145 ,  H04N5/23203 ,  H04N5/23245 ,  H04N5/23293 ,  H04N5/23296 ,  H04N5/2628 ,  H04N7/18 ,  H04N7/181 ,  H04N21/2181 ,  H04N21/239 ,  H04N21/44231

Abstract: A computer system processes a video stream to detect a start of a first motion event candidate in the video stream, and in response to detecting the start of the first motion event candidate in the video stream, initiates event recognition processing on a first video segment associated with the start of the first motion event candidate. Initiating the event recognition processing further includes: determining a motion track of a first object identified in the first video segment; generating a representative motion vector for the first motion event candidate based on the motion track of the first object; and sending the representative motion vector for the first motion event candidate to an event categorizer, where the event categorizer assigns a respective motion event category to the first motion event candidate based on the representative motion vector of the first motion event candidate.

Abstract translation: 计算机系统处理视频流以检测视频流中的第一运动事件候选的开始，并且响应于检测到视频流中的第一运动事件候选者的开始，对相关联的第一视频段启动事件识别处理 与第一运动事件候选人的开始。 启动事件识别处理还包括：确定在第一视频段中识别的第一对象的运动轨迹; 基于所述第一对象的运动轨迹生成所述第一运动事件候选的代表运动矢量; 以及将所述第一运动事件候选的所述代表运动矢量发送到事件分类器，其中所述事件分类器基于所述第一运动事件候选的所述代表运动矢量，将所述运动事件类别分配给所述第一运动事件候选。