公开(公告)号：US07929017B2

公开(公告)日：2011-04-19

申请号：US11192682

申请日：2005-07-28

Applicant: Manoj Aggarwal ,  Harpreet Sawhney ,  Keith Hanna ,  Rakesh Kumar ,  Tao Zhao ,  David R. Patterson ,  David Kalokitis

Inventor： Manoj Aggarwal ,  Harpreet Sawhney ,  Keith Hanna ,  Rakesh Kumar ,  Tao Zhao ,  David R. Patterson ,  David Kalokitis

IPC: H04N5/225

CPC classification number: G01S5/16 ,  G01S3/7864 ,  G01S5/0294 ,  G01S13/767 ,  G06K9/00295 ,  G06K9/00335 ,  G06K9/32 ,  G06K9/6289 ,  G06T7/97 ,  G07C9/00087 ,  G07C9/00111 ,  G08B13/19604 ,  G08B13/19608 ,  G08B13/19641 ,  G08B13/19673 ,  G08B13/19691 ,  G08B13/19697 ,  G08B13/2462 ,  H04N13/243 ,  H04N13/368 ,  H04N2013/0085

Abstract: A unified approach, a fusion technique, a space-time constraint, a methodology, and system architecture are provided. The unified approach is to fuse the outputs of monocular and stereo video trackers, RFID and localization systems and biometric identification systems. The fusion technique is provided that is based on the transformation of the sensory information from heterogeneous sources into a common coordinate system with rigorous uncertainties analysis to account for various sensor noises and ambiguities. The space-time constraint is used to fuse different sensor using the location and velocity information. Advantages include the ability to continuously track multiple humans with their identities in a large area. The methodology is general so that other sensors can be incorporated into the system. The system architecture is provided for the underlying real-time processing of the sensors.

Abstract translation: 提供统一的方法，融合技术，时空约束，方法论和系统架构。 统一的方法是融合单眼和立体视频跟踪器，RFID和定位系统以及生物识别系统的输出。 提供了融合技术，其基于将异构源的感官信息转换成具有严格的不确定性分析的公共坐标系，以解决各种传感器噪声和模糊性。 时空约束用于使用位置和速度信息来融合不同的传感器。 优点包括在大面积上持续跟踪多个人的身份的能力。 该方法是一般的，以便其他传感器可以并入系统。 系统架构提供用于底层实时处理传感器。

公开(公告)号：US20070070069A1

公开(公告)日：2007-03-29

申请号：US11527987

申请日：2006-09-26

Applicant: Supun Samarasekera ,  Rakesh Kumar ,  Taragay Oskiper ,  Harpreet Sawhney ,  Manoj Aggarwal

Inventor： Supun Samarasekera ,  Rakesh Kumar ,  Taragay Oskiper ,  Harpreet Sawhney ,  Manoj Aggarwal

IPC: G06T15/20

CPC classification number: G06T17/05 ,  G06F3/011 ,  G06F16/748

Abstract: The present invention provides a system and method for processing real-time rapid capture, annotation and creation of an annotated hyper-video map for environments. The method includes processing video, audio and GPS data to create the hyper-video map which is further enhanced with textual, audio and hyperlink annotations that will enable the user to see, hear, and operate in an environment with cognitive awareness. Thus, this annotated hyper-video map provides a seamlessly navigable, situational awareness and indexable high-fidelity immersive visualization of the environment.

Abstract translation: 本发明提供了一种用于处理用于环境的带注释的超视频映射的实时快速捕获，注释和创建的系统和方法。 该方法包括处理视频，音频和GPS数据以创建超视频地图，其进一步增强了文本，音频和超链接注释，这将使用户能够在具有认知意识的环境中看到，听到和操作。 因此，该注释的超视频地图提供了无缝导航的情境感知和可索引的高保真度的环境可视化。

公开(公告)号：US20070064107A1

公开(公告)日：2007-03-22

申请号：US11524134

申请日：2006-09-20

Applicant: Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

Inventor： Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

IPC: H04N7/18

CPC classification number: H04N7/181 ,  G01S3/7864

Abstract: A system for tracking at least one object, comprising: a plurality of communicatively connected visual sensing units configured to capture visual data related to the at least one object; and a manager component communicatively connected to the plurality of visual sensing units, where the manager component is configured to assign one visual sensing unit to act as a visual sensing unit in a master mode and at least one visual sensing unit to act as a visual sensing unit in a slave mode, transmit at least one control signal to the plurality of visual sensing units, and receive the visual data from the plurality of visual sensing units.

Abstract translation: 一种用于跟踪至少一个对象的系统，包括：多个通信连接的视觉感测单元，被配置为捕获与所述至少一个对象有关的视觉数据; 以及管理器组件，其通信地连接到所述多个视觉感测单元，其中所述管理器组件被配置为分配一个视觉感测单元以用作主模式中的视觉感测单元，以及至少一个视觉感测单元用作视觉感测 单元处于从模式，将至少一个控制信号发送到多个视觉感测单元，并从多个视觉感测单元接收视觉数据。

公开(公告)号：US08639046B2

公开(公告)日：2014-01-28

申请号：US12773823

申请日：2010-05-04

Applicant: Manoj Aggarwal

Inventor： Manoj Aggarwal

IPC: G06K9/36

CPC classification number: H04N19/162 ,  H04N19/31 ,  H04N19/436 ,  H04N19/46 ,  H04N19/597 ,  H04N19/63 ,  H04N21/2343 ,  H04N21/25825 ,  H04N21/2665 ,  H04N21/4621 ,  H04N21/631 ,  H04N21/6377 ,  H04N21/658

Abstract: A scalable method and apparatus is described to provide personalized interactive visualization of a plurality of compressed image data to a plurality of concurrent users. A plurality of image sources are digitally processed in the compressed domain to provide controllable enhanced user-specific interactive visualization with support for adjustment in viewing parameters such frame-rate, field of view, resolution, color format, viewpoint and bandwidth.

Abstract translation: 描述了可扩展的方法和装置，以向多个并发用户提供多个压缩图像数据的个性化交互式可视化。 多个图像源在压缩域中进行数字处理，以提供可控的增强的用户特定的交互式可视化，支持对诸如帧率，视场，分辨率，颜色格式，视点和带宽之类的参数的调整。

公开(公告)号：US08310554B2

公开(公告)日：2012-11-13

申请号：US11524134

申请日：2006-09-20

Applicant: Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

Inventor： Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

IPC: H04N5/232

CPC classification number: H04N7/181 ,  G01S3/7864

Abstract: A system for tracking at least one object is disclosed. The system includes a plurality of communicatively connected visual sensing units configured to capture visual data related to the at least one object The system also includes a manager component communicatively connected to the plurality of visual sensing units. The manager component is configured to assign one visual sensing unit to act as a visual sensing unit in a master mode and at least one visual sensing unit to act as a visual sensing unit in a slave mode. The manager component is further configured to transmit at least one control signal to the plurality of visual sensing units, and receive the visual data from the plurality of visual sensing units.

Abstract translation: 公开了一种用于追踪至少一个物体的系统。 该系统包括多个通信连接的视觉感测单元，其被配置为捕获与至少一个对象相关的视觉数据。该系统还包括通信地连接到多个视觉感测单元的管理器组件。 管理器组件被配置为分配一个视觉感测单元以用作主模式中的视觉感测单元，并且至少一个视觉感测单元用作从模式中的视觉感测单元。 管理器组件还被配置为向多个视觉感测单元发送至少一个控制信号，并从多个视觉感测单元接收视觉数据。

公开(公告)号：US20100278508A1

公开(公告)日：2010-11-04

申请号：US12773823

申请日：2010-05-04

Applicant: Manoj Aggarwal

Inventor： Manoj Aggarwal

IPC: H04N7/26 ,  H04N7/12

CPC classification number: H04N19/162 ,  H04N19/31 ,  H04N19/436 ,  H04N19/46 ,  H04N19/597 ,  H04N19/63 ,  H04N21/2343 ,  H04N21/25825 ,  H04N21/2665 ,  H04N21/4621 ,  H04N21/631 ,  H04N21/6377 ,  H04N21/658

Abstract: A scalable method and apparatus is described to provide personalized interactive visualization of a plurality of compressed image data to a plurality of concurrent users. A plurality of image sources are digitally processed in the compressed domain to provide controllable enhanced user-specific interactive visualization with support for adjustment in viewing parameters such frame-rate, field of view, resolution, color format, viewpoint and bandwidth.

Abstract translation: 描述了可扩展的方法和装置，以向多个并发用户提供多个压缩图像数据的个性化交互式可视化。 多个图像源在压缩域中进行数字处理，以提供可控的增强的用户特定的交互式可视化，支持对诸如帧率，视场，分辨率，颜色格式，视点和带宽之类的参数的调整。

公开(公告)号：US07706571B2

公开(公告)日：2010-04-27

申请号：US11250181

申请日：2005-10-13

Applicant: Subhodev Das ,  Manoj Aggarwal ,  Harpreet Singh Sawhney ,  Rakesh Kumar ,  Supun Samarasekera

Inventor： Subhodev Das ,  Manoj Aggarwal ,  Harpreet Singh Sawhney ,  Rakesh Kumar ,  Supun Samarasekera

IPC: G06K9/00

CPC classification number: G06K9/32 ,  G06K9/00369 ,  G06T7/251 ,  G06T7/277 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30232

Abstract: Method for tracking an object recorded within a selected frame of a sequence of frames of video data, using a plurality of layers, where at least one object layer of the plurality of layers represents the object includes initializing layer ownership probabilities for pixels of the selected frame using a non-parametric motion model, estimating a set of motion parameters of the plurality of layers for the selected frame using a parametric maximization algorithm and tracking the object. The non-parametric motion model is optical flow and includes warping the mixing probabilities, the appearances of the plurality of layers, and the observed pixel data from the pixels of the preceding frame to the pixels of the selected frame to initialize the layer ownership probabilities for the pixels of the selected frame.

Abstract translation: 用于使用多个层来跟踪记录在视频数据帧序列的所选帧内的对象的方法，其中多个层中的至少一个对象层表示对象包括初始化所选帧的像素的层所有权概率 使用非参数运动模型，使用参数最大化算法估计所选择的帧的所述多个层的运动参数的集合并跟踪所述对象。 非参数运动模型是光流，包括混合概率，多层的出现以及从前一帧的像素到所选帧的像素的观察像素数据的变形，以初始化层所有权概率 所选帧的像素。

公开(公告)号：US07639840B2

公开(公告)日：2009-12-29

申请号：US11192484

申请日：2005-07-28

Applicant: Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney ,  Rakesh Kumar

Inventor： Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney ,  Rakesh Kumar

IPC: G06K9/00 ,  G06K9/62

CPC classification number: G06K9/00771 ,  G08B13/19613

Abstract: A method and apparatus for video surveillance is disclosed. In one embodiment, a sequence of scene imagery representing a field of view is received. One or more moving objects are identified within the sequence of scene imagery and then classified in accordance with one or more extracted spatio-temporal features. This classification may then be applied to determine whether the moving object and/or its behavior fits one or more known events or behaviors that are causes for alarm.

Abstract translation: 公开了一种用于视频监控的方法和装置。 在一个实施例中，接收表示视场的场景图像序列。 在场景图像的序列内识别一个或多个移动物体，然后根据一个或多个提取的时空特征进行分类。 然后可以应用该分类以确定移动物体和/或其行为是否适合作为警报原因的一个或多个已知事件或行为。

公开(公告)号：US07382898B2

公开(公告)日：2008-06-03

申请号：US11152889

申请日：2005-06-15

Applicant: Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

Inventor： Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

IPC: G06K9/00

CPC classification number: G06K9/00771 ,  G08B13/19613 ,  G08B31/00

Abstract: A method and apparatus for detecting objects (e.g., bags, vehicles, etc.) left in a field of view are disclosed. A long-term representation and a short-term representation of the field of view are constructed, and a difference between the long-term representation and the short-term representation is calculated. One or more criteria may optionally be applied to this difference to determine whether the difference represents an object that was left in the field of view.

Abstract translation: 公开了一种用于检测留在视野中的物体（例如袋，车辆等）的方法和装置。 构建长期代表性和短期代表性，计算长期代表与短期代表之间的差额。 一个或多个标准可以可选地应用于该差异以确定差异是否表示留在视野中的对象。

公开(公告)号：US20070035622A1

公开(公告)日：2007-02-15

申请号：US11141811

申请日：2005-06-01

Applicant: Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney

Inventor： Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney

IPC: H04N7/18 ,  H04N5/225

CPC classification number: G06T7/20 ,  G06K9/00771 ,  G08B13/19602 ,  G08B13/19606 ,  G08B13/19613 ,  H04N5/144 ,  H04N7/188

Abstract: A method and apparatus for performing video surveillance of a field of view is disclosed. In one embodiment, a method for performing surveillance of the field of view includes monitoring the field of view and detecting a moving object in the field of view, where the motion is detected based on a spatio-temporal signature (e.g., a set of descriptive feature vectors) of the moving object.

Abstract translation: 公开了一种用于执行视场监视的方法和装置。 在一个实施例中，用于执行视场监视的方法包括监视视场并检测视野中的移动物体，其中基于时空特征（例如，一组描述性的 特征向量）。