公开(公告)号：US09226037B2

公开(公告)日：2015-12-29

申请号：US12982326

申请日：2010-12-30

申请人： Hongwei Zhu ,  Greg Millar ,  Farzin Aghdasi ,  Lei Wang ,  Shu Yang

发明人： Hongwei Zhu ,  Greg Millar ,  Farzin Aghdasi ,  Lei Wang ,  Shu Yang

IPC分类号： H04N9/80 ,  H04N21/482 ,  H04N5/76 ,  G06K9/00 ,  G06F17/30

CPC分类号： H04N21/4828 ,  G06F17/3079 ,  G06F17/30817 ,  G06F17/30828 ,  G06F17/30834 ,  G06K9/00771 ,  H04N5/76

摘要： Embodiments of the disclosure provide for systems and methods for searching video data for events and/or behaviors. An inference engine can be used to aide in the searching. In some embodiments, a user can specify various search criteria, for example, a video source(s), an event(s) or behavior(s) to search, and an action(s) to perform in the event of a successful search. The search can be performed by analyzing an object(s) found within scenes of the video data. An object can be identified by a number of attributes specified by the user. Once the search criteria has been received from the user, the video data can be received (or extracted from storage), the data analyzed for the specified events (or behaviors), and the specified action performed in the event a successful search occurs.

摘要翻译： 本公开的实施例提供了用于搜索事件和/或行为的视频数据的系统和方法。 推理机可以用于辅助搜索。 在一些实施例中，用户可以指定各种搜索标准，例如视频源，要搜索的事件或行为，以及在成功搜索的情况下执行的动作 。 可以通过分析在视频数据的场景内发现的对象来执行搜索。 可以通过用户指定的多个属性来标识对象。 一旦从用户接收到搜索标准，就可以接收（或从存储中提取）视频数据，分析指定事件（或行为）的数据，以及在发生成功搜索的情况下执行的指定动作。

公开(公告)号：US20130176430A1

公开(公告)日：2013-07-11

申请号：US13345228

申请日：2012-01-06

申请人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar ,  Lei Wang

发明人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar ,  Lei Wang

IPC分类号： H04N7/18

CPC分类号： G06T7/2053 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30232

摘要： An image capture system includes: an image capture unit configured to capture a first image frame comprising a set of pixels; and a processor coupled to the image capture unit and configured to: determine a normalized distance of a pixel characteristic between the first image frame and a second image frame for each pixel in the first image frame; compare the normalized distance for each pixel in the first image frame against a pixel sensitivity value for that pixel; determine that a particular pixel of the first image frame is a foreground or background pixel based on the normalized distance of the particular pixel relative to the pixel sensitivity value for the particular pixel; and adapt the pixel sensitivity value for each pixel over a range of allowable pixel sensitivity values.

摘要翻译： 图像拍摄系统包括：图像拍摄单元，被配置为捕获包括一组像素的第一图像帧; 以及处理器，其耦合到所述图像捕获单元并且被配置为：确定所述第一图像帧中的每个像素的所述第一图像帧和第二图像帧之间的像素特性的归一化距离; 将第一图像帧中的每个像素的归一化距离与该像素的像素灵敏度值进行比较; 基于特定像素相对于特定像素的像素灵敏度值的归一化距离，确定第一图像帧的特定像素是前景或背景像素; 并且在允许的像素灵敏度值的范围内适应每个像素的像素灵敏度值。

公开(公告)号：US20130166711A1

公开(公告)日：2013-06-27

申请号：US13335591

申请日：2011-12-22

申请人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： G06F15/173

CPC分类号： G08B13/19671 ,  G08B13/19643 ,  G08B13/19645 ,  G08B13/19656 ,  H04N7/181 ,  H04N21/44008 ,  H04N21/4828 ,  H04N21/8133

摘要： Systems and methods are described herein that provide a three-tier intelligent video surveillance management system. An example of a system described herein includes a gateway configured to obtain video content and metadata relating to the video content from a plurality of network devices, a metadata processing module communicatively coupled to the gateway and configured to filter the metadata according to one or more criteria to obtain a filtered set of metadata, a video processing module communicatively coupled to the gateway and the metadata processing module and configured to isolate video portions, of video the content, associated with respective first portions of the filtered set of metadata, and a cloud services interface communicatively coupled to the gateway, the metadata processing module and the video processing module and configured to provide at least some of the filtered set of metadata or the isolated video portions to a cloud computing service.

摘要翻译： 本文描述了提供三层智能视频监控管理系统的系统和方法。 本文描述的系统的示例包括被配置为从多个网络设备获取与视频内容相关的视频内容和元数据的网关，通信地耦合到网关并被配置为根据一个或多个标准过滤元数据的元数据处理模块 以获得过滤的元数据集合，通信地耦合到网关和元数据处理模块的视频处理模块，并且被配置为将与所筛选的元数据集合的相应第一部分相关联的视频内容的视频部分隔离，以及云服务 接口，通信地耦合到网关，元数据处理模块和视频处理模块，并且被配置为向云计算服务提供过滤的元数据集合或孤立视频部分中的至少一些。

公开(公告)号：US20120170902A1

公开(公告)日：2012-07-05

申请号：US12982326

申请日：2010-12-30

申请人： Hongwei Zhu ,  Greg Millar ,  Farzin Aghdasi ,  Lei Wang ,  Shu Yang

发明人： Hongwei Zhu ,  Greg Millar ,  Farzin Aghdasi ,  Lei Wang ,  Shu Yang

IPC分类号： H04N5/77 ,  G06F17/30 ,  G06K9/00

CPC分类号： H04N21/4828 ,  G06F17/3079 ,  G06F17/30817 ,  G06F17/30828 ,  G06F17/30834 ,  G06K9/00771 ,  H04N5/76

摘要： Embodiments of the disclosure provide for systems and methods for searching video data for events and/or behaviors. An inference engine can be used to aide in the searching. In some embodiments, a user can specify various search criteria, for example, a video source(s), an event(s) or behavior(s) to search, and an action(s) to perform in the event of a successful search. The search can be performed by analyzing an object(s) found within scenes of the video data. An object can be identified by a number of attributes specified by the user. Once the search criteria has been received from the user, the video data can be received (or extracted from storage), the data analyzed for the specified events (or behaviors), and the specified action performed in the event a successful search occurs.

摘要翻译： 本公开的实施例提供了用于搜索事件和/或行为的视频数据的系统和方法。 推理机可以用于辅助搜索。 在一些实施例中，用户可以指定各种搜索标准，例如视频源，要搜索的事件或行为，以及在成功搜索的情况下执行的动作 。 可以通过分析在视频数据的场景内发现的对象来执行搜索。 可以通过用户指定的多个属性来标识对象。 一旦从用户接收到搜索标准，就可以接收（或从存储中提取）视频数据，分析指定事件（或行为）的数据，以及在发生成功搜索的情况下执行的指定动作。

公开(公告)号：US09681125B2

公开(公告)日：2017-06-13

申请号：US13340564

申请日：2011-12-29

申请人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： H04N19/00 ,  H04N19/17 ,  H04N19/23 ,  H04N19/107 ,  H04N19/174 ,  G06K9/00 ,  H04N7/18 ,  H04N5/225 ,  G06T7/11 ,  G06T7/254 ,  G06T7/194

CPC分类号： H04N19/00 ,  G06T7/11 ,  G06T7/194 ,  G06T7/254 ,  G06T2207/20021 ,  G06T2207/20081 ,  H04N19/107 ,  H04N19/17 ,  H04N19/174 ,  H04N19/23

摘要： A method of video coding includes receiving a video image having a plurality of pixels, selecting a plurality of Gaussian models for each pixel, classifying each pixel as a background or foreground pixel, determining if an object is always moving locally by detecting if an object is always moving within a predetermined distance and changing the direction of moving frequently for a second predetermined period of time, removing an object from classification as an object and ignoring motion of the object if the object is always moving locally, marking the area that the object moves within as a noisy area on a noise mask buffer, updating background models based on motion detection and noise filtering, updating current and evolving background images, and coding the current background image, background update blocks and objects for transmission.

公开(公告)号：US10769913B2

公开(公告)日：2020-09-08

申请号：US13335591

申请日：2011-12-22

申请人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： G08B13/196 ,  H04N7/18 ,  H04N21/44 ,  H04N21/81 ,  H04N21/482

摘要： Systems and methods are described herein that provide a three-tier intelligent video surveillance management system. An example of a system described herein includes a gateway configured to obtain video content and metadata relating to the video content from a plurality of network devices, a metadata processing module communicatively coupled to the gateway and configured to filter the metadata according to one or more criteria to obtain a filtered set of metadata, a video processing module communicatively coupled to the gateway and the metadata processing module and configured to isolate video portions, of video the content, associated with respective first portions of the filtered set of metadata, and a cloud services interface communicatively coupled to the gateway, the metadata processing module and the video processing module and configured to provide at least some of the filtered set of metadata or the isolated video portions to a cloud computing service.

公开(公告)号：US09530221B2

公开(公告)日：2016-12-27

申请号：US13345228

申请日：2012-01-06

申请人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar ,  Lei Wang

发明人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar ,  Lei Wang

IPC分类号： H04N7/00 ,  G06T7/20

CPC分类号： G06T7/2053 ,  G06T7/254 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30232

摘要： An image capture system includes: an image capture unit configured to capture a first image frame comprising a set of pixels; and a processor coupled to the image capture unit and configured to: determine a normalized distance of a pixel characteristic between the first image frame and a second image frame for each pixel in the first image frame; compare the normalized distance for each pixel in the first image frame against a pixel sensitivity value for that pixel; determine that a particular pixel of the first image frame is a foreground or background pixel based on the normalized distance of the particular pixel relative to the pixel sensitivity value for the particular pixel; and adapt the pixel sensitivity value for each pixel over a range of allowable pixel sensitivity values.

摘要翻译： 图像拍摄系统包括：图像拍摄单元，被配置为捕获包括一组像素的第一图像帧; 以及处理器，其耦合到所述图像捕获单元并且被配置为：确定所述第一图像帧中的每个像素的所述第一图像帧和第二图像帧之间的像素特性的归一化距离; 将第一图像帧中的每个像素的归一化距离与该像素的像素灵敏度值进行比较; 基于特定像素相对于特定像素的像素灵敏度值的归一化距离，确定第一图像帧的特定像素是前景或背景像素; 并且在允许的像素灵敏度值的范围内适应每个像素的像素灵敏度值。

公开(公告)号：US20130170557A1

公开(公告)日：2013-07-04

申请号：US13340564

申请日：2011-12-29

申请人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Lei Wang ,  Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： H04N7/26

CPC分类号： H04N19/00 ,  G06T7/11 ,  G06T7/194 ,  G06T7/254 ,  G06T2207/20021 ,  G06T2207/20081 ,  H04N19/107 ,  H04N19/17 ,  H04N19/174 ,  H04N19/23

摘要： Techniques are discussed herein for providing mechanisms for coding and transmitting high definition video, e.g., over low bandwidth connections. In particular, foreground-objects are identified as distinct from the background of a scene represented by a plurality of video frames. In identifying foreground-objects, semantically significant and semantically insignificant movement (e.g., non-repetitive versus repetitive movement) is differentiated. For example, the swaying motion of a tree's leaves being minor and repetitive, can be determined to be semantically insignificant and to belong in a scene's background. Processing of the foreground-objects and background proceed at different update rates or frequencies. For example, foreground-objects can be updated 30 or 60 times per second. By contrast, a background is updated less frequently, e.g., once every 10 seconds. In some implementations, if no foreground-objects are identified, no live video is transmitted (e.g., if no motion is detected, static images are not configured to be repeatedly sent). Techniques described herein take advantage of the realization that, in the area of surveillance and wireless communications, updating video of semantically significant movement at a high frame rate is sufficient.

摘要翻译： 本文讨论了用于提供用于编码和传输高清晰度视频（例如，通过低带宽连接）的机制的技术。 特别地，前景对象被识别为与由多个视频帧表示的场景的背景不同。 在识别前景对象时，区分了语义上重要的和语义上不显着的移动（例如，非重复性与重复运动）。 例如，树叶的摇摆运动是小而重复的，可以被确定为语义上不重要，属于场景的背景。 前景对象和背景的处理以不同的更新速率或频率进行。 例如，前景对象可以每秒更新30或60次。 相比之下，背景的更新频率更低，例如每10秒钟一次。 在一些实现中，如果没有识别出前景对象，则不发送实况视频（例如，如果没有检测到运动，静态图像不被配置为被重复发送）。 本文描述的技术利用了以下认识：在监视和无线通信领域中，以高帧速率更新语义上显着的运动的视频是足够的。

公开(公告)号：US08744125B2

公开(公告)日：2014-06-03

申请号：US13338617

申请日：2011-12-28

申请人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： G06K9/00

CPC分类号： G06K9/68

摘要： An example of a method for identifying objects in video content according to the disclosure includes receiving video content of a scene captured by a video camera, detecting an object in the video content, identifying a track that the object follows over a series of frames of the video content, extracting object features for the object from the video content, and classifying the object based on the object features. Classifying the object further comprises: determining a track-level classification for the object using spatially invariant object features, determining a global-clustering classification for the object using spatially variant features, and determining an object type for the object based on the track-level classification and the global-clustering classification for the object.

摘要翻译： 根据本公开的用于识别视频内容中的对象的方法的示例包括：接收由摄像机捕获的场景的视频内容，检测视频内容中的对象，识别该对象在一系列帧上跟随的轨迹 视频内容，从视频内容提取对象的对象特征，以及基于对象特征对对象进行分类。 分类对象还包括：使用空间不变对象特征来确定对象的轨道级分类，使用空间变异特征确定对象的全局聚类分类，以及基于轨道级分类确定对象的对象类型 和对象的全局聚类分类。

公开(公告)号：US09286678B2

公开(公告)日：2016-03-15

申请号：US13338555

申请日：2011-12-28

申请人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

发明人： Hongwei Zhu ,  Farzin Aghdasi ,  Greg Millar

IPC分类号： G06T7/00 ,  G06T19/00 ,  H04N7/18

CPC分类号： G06T7/0018 ,  G06T7/80 ,  G06T2207/10016 ,  G06T2207/20076 ,  G06T2207/30196 ,  G06T2207/30232 ,  G06T2207/30236

摘要： Disclosed are methods, systems, computer readable media and other implementations, including a method to calibrate a camera that includes capturing by the camera a frame of a scene, identifying features appearing in the captured frame, the features associated with pre-determined values representative of physical attributes of one or more objects, and determining parameters of the camera based on the identified features appearing in the captured frame and the pre-determined values associated with the identified features.

摘要翻译： 公开了方法，系统，计算机可读介质和其他实施方式，包括校准相机的方法，其包括由相机拍摄场景的帧，识别出现在所捕获的帧中的特征，与代表 一个或多个对象的物理属性，以及基于所捕获的帧中出现的所识别的特征以及与所识别的特征相关联的预定值来确定摄像机的参数。