公开(公告)号：US08639046B2

公开(公告)日：2014-01-28

申请号：US12773823

申请日：2010-05-04

Applicant: Manoj Aggarwal

Inventor： Manoj Aggarwal

IPC: G06K9/36

CPC classification number: H04N19/162 ,  H04N19/31 ,  H04N19/436 ,  H04N19/46 ,  H04N19/597 ,  H04N19/63 ,  H04N21/2343 ,  H04N21/25825 ,  H04N21/2665 ,  H04N21/4621 ,  H04N21/631 ,  H04N21/6377 ,  H04N21/658

Abstract: A scalable method and apparatus is described to provide personalized interactive visualization of a plurality of compressed image data to a plurality of concurrent users. A plurality of image sources are digitally processed in the compressed domain to provide controllable enhanced user-specific interactive visualization with support for adjustment in viewing parameters such frame-rate, field of view, resolution, color format, viewpoint and bandwidth.

Abstract translation: 描述了可扩展的方法和装置，以向多个并发用户提供多个压缩图像数据的个性化交互式可视化。 多个图像源在压缩域中进行数字处理，以提供可控的增强的用户特定的交互式可视化，支持对诸如帧率，视场，分辨率，颜色格式，视点和带宽之类的参数的调整。

公开(公告)号：US08310554B2

公开(公告)日：2012-11-13

申请号：US11524134

申请日：2006-09-20

Applicant: Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

Inventor： Manoj Aggarwal ,  Deepak Sethi ,  Supun Samarasekera ,  Vince Paragano

IPC: H04N5/232

CPC classification number: H04N7/181 ,  G01S3/7864

Abstract: A system for tracking at least one object is disclosed. The system includes a plurality of communicatively connected visual sensing units configured to capture visual data related to the at least one object The system also includes a manager component communicatively connected to the plurality of visual sensing units. The manager component is configured to assign one visual sensing unit to act as a visual sensing unit in a master mode and at least one visual sensing unit to act as a visual sensing unit in a slave mode. The manager component is further configured to transmit at least one control signal to the plurality of visual sensing units, and receive the visual data from the plurality of visual sensing units.

Abstract translation: 公开了一种用于追踪至少一个物体的系统。 该系统包括多个通信连接的视觉感测单元，其被配置为捕获与至少一个对象相关的视觉数据。该系统还包括通信地连接到多个视觉感测单元的管理器组件。 管理器组件被配置为分配一个视觉感测单元以用作主模式中的视觉感测单元，并且至少一个视觉感测单元用作从模式中的视觉感测单元。 管理器组件还被配置为向多个视觉感测单元发送至少一个控制信号，并从多个视觉感测单元接收视觉数据。

公开(公告)号：US20100278508A1

公开(公告)日：2010-11-04

申请号：US12773823

申请日：2010-05-04

Applicant: Manoj Aggarwal

Inventor： Manoj Aggarwal

IPC: H04N7/26 ,  H04N7/12

CPC classification number: H04N19/162 ,  H04N19/31 ,  H04N19/436 ,  H04N19/46 ,  H04N19/597 ,  H04N19/63 ,  H04N21/2343 ,  H04N21/25825 ,  H04N21/2665 ,  H04N21/4621 ,  H04N21/631 ,  H04N21/6377 ,  H04N21/658

Abstract: A scalable method and apparatus is described to provide personalized interactive visualization of a plurality of compressed image data to a plurality of concurrent users. A plurality of image sources are digitally processed in the compressed domain to provide controllable enhanced user-specific interactive visualization with support for adjustment in viewing parameters such frame-rate, field of view, resolution, color format, viewpoint and bandwidth.

Abstract translation: 描述了可扩展的方法和装置，以向多个并发用户提供多个压缩图像数据的个性化交互式可视化。 多个图像源在压缩域中进行数字处理，以提供可控的增强的用户特定的交互式可视化，支持对诸如帧率，视场，分辨率，颜色格式，视点和带宽之类的参数的调整。

公开(公告)号：US07706571B2

公开(公告)日：2010-04-27

申请号：US11250181

申请日：2005-10-13

Applicant: Subhodev Das ,  Manoj Aggarwal ,  Harpreet Singh Sawhney ,  Rakesh Kumar ,  Supun Samarasekera

Inventor： Subhodev Das ,  Manoj Aggarwal ,  Harpreet Singh Sawhney ,  Rakesh Kumar ,  Supun Samarasekera

IPC: G06K9/00

CPC classification number: G06K9/32 ,  G06K9/00369 ,  G06T7/251 ,  G06T7/277 ,  G06T2207/10016 ,  G06T2207/30196 ,  G06T2207/30232

Abstract: Method for tracking an object recorded within a selected frame of a sequence of frames of video data, using a plurality of layers, where at least one object layer of the plurality of layers represents the object includes initializing layer ownership probabilities for pixels of the selected frame using a non-parametric motion model, estimating a set of motion parameters of the plurality of layers for the selected frame using a parametric maximization algorithm and tracking the object. The non-parametric motion model is optical flow and includes warping the mixing probabilities, the appearances of the plurality of layers, and the observed pixel data from the pixels of the preceding frame to the pixels of the selected frame to initialize the layer ownership probabilities for the pixels of the selected frame.

Abstract translation: 用于使用多个层来跟踪记录在视频数据帧序列的所选帧内的对象的方法，其中多个层中的至少一个对象层表示对象包括初始化所选帧的像素的层所有权概率 使用非参数运动模型，使用参数最大化算法估计所选择的帧的所述多个层的运动参数的集合并跟踪所述对象。 非参数运动模型是光流，包括混合概率，多层的出现以及从前一帧的像素到所选帧的像素的观察像素数据的变形，以初始化层所有权概率 所选帧的像素。

公开(公告)号：US07639840B2

公开(公告)日：2009-12-29

申请号：US11192484

申请日：2005-07-28

Applicant: Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney ,  Rakesh Kumar

Inventor： Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney ,  Rakesh Kumar

IPC: G06K9/00 ,  G06K9/62

CPC classification number: G06K9/00771 ,  G08B13/19613

Abstract: A method and apparatus for video surveillance is disclosed. In one embodiment, a sequence of scene imagery representing a field of view is received. One or more moving objects are identified within the sequence of scene imagery and then classified in accordance with one or more extracted spatio-temporal features. This classification may then be applied to determine whether the moving object and/or its behavior fits one or more known events or behaviors that are causes for alarm.

Abstract translation: 公开了一种用于视频监控的方法和装置。 在一个实施例中，接收表示视场的场景图像序列。 在场景图像的序列内识别一个或多个移动物体，然后根据一个或多个提取的时空特征进行分类。 然后可以应用该分类以确定移动物体和/或其行为是否适合作为警报原因的一个或多个已知事件或行为。

公开(公告)号：US07382898B2

公开(公告)日：2008-06-03

申请号：US11152889

申请日：2005-06-15

Applicant: Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

Inventor： Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

IPC: G06K9/00

CPC classification number: G06K9/00771 ,  G08B13/19613 ,  G08B31/00

Abstract: A method and apparatus for detecting objects (e.g., bags, vehicles, etc.) left in a field of view are disclosed. A long-term representation and a short-term representation of the field of view are constructed, and a difference between the long-term representation and the short-term representation is calculated. One or more criteria may optionally be applied to this difference to determine whether the difference represents an object that was left in the field of view.

Abstract translation: 公开了一种用于检测留在视野中的物体（例如袋，车辆等）的方法和装置。 构建长期代表性和短期代表性，计算长期代表与短期代表之间的差额。 一个或多个标准可以可选地应用于该差异以确定差异是否表示留在视野中的对象。

公开(公告)号：US20070035622A1

公开(公告)日：2007-02-15

申请号：US11141811

申请日：2005-06-01

Applicant: Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney

Inventor： Keith Hanna ,  Manoj Aggarwal ,  Harpreet Sawhney

IPC: H04N7/18 ,  H04N5/225

CPC classification number: G06T7/20 ,  G06K9/00771 ,  G08B13/19602 ,  G08B13/19606 ,  G08B13/19613 ,  H04N5/144 ,  H04N7/188

Abstract: A method and apparatus for performing video surveillance of a field of view is disclosed. In one embodiment, a method for performing surveillance of the field of view includes monitoring the field of view and detecting a moving object in the field of view, where the motion is detected based on a spatio-temporal signature (e.g., a set of descriptive feature vectors) of the moving object.

Abstract translation: 公开了一种用于执行视场监视的方法和装置。 在一个实施例中，用于执行视场监视的方法包括监视视场并检测视野中的移动物体，其中基于时空特征（例如，一组描述性的 特征向量）。

公开(公告)号：US20060279630A1

公开(公告)日：2006-12-14

申请号：US11192486

申请日：2005-07-28

Applicant: Manoj Aggarwal ,  Keith Hanna ,  Harpreet Sawhney ,  Vincent Paragano ,  Rakesh Kumar ,  Supun Samarasekera ,  Aydin Arpa ,  Thomas Germano ,  Tao Zhao ,  David Kalokitis ,  David Patterson

Inventor： Manoj Aggarwal ,  Keith Hanna ,  Harpreet Sawhney ,  Vincent Paragano ,  Rakesh Kumar ,  Supun Samarasekera ,  Aydin Arpa ,  Thomas Germano ,  Tao Zhao ,  David Kalokitis ,  David Patterson

IPC: H04N7/18 ,  H04N13/00 ,  H04N5/225 ,  H04N15/00 ,  H04N9/47

CPC classification number: G01S3/7864 ,  G06K9/00771 ,  G06K9/32 ,  G06K9/6289 ,  G06T7/246 ,  G06T7/285 ,  G06T7/292 ,  G06T7/70 ,  G06T2207/30232 ,  G06T2207/30241 ,  G08B13/19608 ,  G08B13/19641 ,  G08B13/19645 ,  G08B13/19682 ,  H04N5/2224 ,  H04N5/76 ,  H04N13/204 ,  H04N13/239 ,  H04N13/243 ,  H04N2013/0081 ,  H04N2013/0085

Abstract: A sentient system combines detection, tracking, and immersive visualization of a cluttered and crowded environment, such as an office building, terminal, or other enclosed site using a network of stereo cameras. A guard monitors the site using a live 3D model, which is updated from different directions using the multiple video streams. As a person moves within the view of a camera, the system detects its motion and tracks the person's path, it hands off the track to the next camera when the person goes out of that camera's view. Multiple people can be tracked simultaneously both within and across cameras, with each track shown on a map display. The track system includes a track map browser that displays the tracks of all moving objects as well as a history of recent tracks and a video flashlight viewer that displays live immersive video of any person that is being tracked.

Abstract translation: 有声系统使用立体相机网络将杂乱无章的环境（例如办公楼，终端或其他封闭场所）的检测，跟踪和沉浸式可视化相结合。 守卫使用实时3D模型监视站点，该模型使用多个视频流从不同方向更新。 当一个人在相机的视野内移动时，系统会检测到其运动并跟踪人的路径，当人离开该相机视图时，它将该轨迹移离下一个相机。 可以在摄像机内和摄像机上同时跟踪多个人，每个轨道显示在地图显示上。 轨道系统包括轨迹映射浏览器，其显示所有运动对象的轨迹以及最近轨道的历史以及显示正在被跟踪的任何人的现场沉浸式视频的视频手电筒观看者。

公开(公告)号：US20060002586A1

公开(公告)日：2006-01-05

申请号：US11152889

申请日：2005-06-15

Applicant: Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

Inventor： Manoj Aggarwal ,  Supun Samarasekera ,  Keith Hanna

IPC: G06K9/00

CPC classification number: G06K9/00771 ,  G08B13/19613 ,  G08B31/00

Abstract: A method and apparatus for detecting objects (e.g., bags, vehicles, etc.) left in a field of view are disclosed. A long-term representation and a short-term representation of the field of view are constructed, and a difference between the long-term representation and the short-term representation is calculated. One or more criteria may optionally be applied to this difference to determine whether the difference represents an object that was left in the field of view.

Abstract translation: 公开了一种用于检测留在视野中的物体（例如袋，车辆等）的方法和装置。 构建长期代表性和短期代表性，计算长期代表与短期代表之间的差额。 一个或多个标准可以可选地应用于该差异以确定差异是否表示留在视野中的对象。

公开(公告)号：US6008853A

公开(公告)日：1999-12-28

申请号：US967559

申请日：1997-11-12

Applicant: Ajai Narayan ,  Manoj Aggarwal ,  Bruce E. Flinchbaugh

Inventor： Ajai Narayan ,  Manoj Aggarwal ,  Bruce E. Flinchbaugh

IPC: H04N5/92 ,  H04N5/232 ,  H04N7/26 ,  H04N7/30 ,  H04N7/36 ,  H04N7/46 ,  H04N7/50 ,  H04N7/52 ,  H04N11/04 ,  H04N21/236 ,  H04N21/4143 ,  H04N21/434

CPC classification number: H04N21/4143 ,  H04N19/132 ,  H04N19/156 ,  H04N19/17 ,  H04N19/176 ,  H04N19/184 ,  H04N19/186 ,  H04N19/44 ,  H04N19/503 ,  H04N19/587 ,  H04N19/60 ,  H04N19/90 ,  H04N21/236 ,  H04N21/434 ,  H04N5/232 ,  H04N19/30

Abstract: This invention is a method of decoding a stream of video image data transmitted as independent image frames consisting of plural marcoblocks transmitted in a nonsequential order. The method defines a sub-frame corresponding to a proper subset of the full frame. The method determines if a currently received macroblock is within the sub-frame. The method decodes the sub-frame. The sub-frame may be decoded at less than or equal to the frame rate of the video image data. A table has one entry for each macroblock that stores a transmission order within the video frame for the corresponding macroblock. The method determine if a current macroblock is within the sub-frame by reading the table. Each macroblock consists of a plurality of contiguous blocks and includes luminance data for any included blocks and chrominance data for the macroblock as a whole. The method optionally decodes the luminance data for each included block and ignores the chrominance data. The method decodes the sub-frame employing only data prior to an end of data marker or the end of a data group allocated to that block, and ignores data following an end of data marker. The method may also decode a full frame of video image data at a full frame decode rate less than the sub-frame decode rate. The method preferably employs a digital camcorder to generate the stream of video image data and a notebook computer for decoding and display.

Abstract translation: 本发明是一种解码作为独立图像帧发送的视频图像数据流的方法，该独立图像帧由以非顺序发送的多个marcoblock组成。 该方法定义对应于全帧的正确子集的子帧。 该方法确定当前接收的宏块是否在子帧内。 该方法解码子帧。 子帧可以以小于或等于视频图像数据的帧速率被解码。 表格对于每个宏块具有一个条目，其存储在相应宏块的视频帧内的传输顺序。 该方法通过读表确定当前宏块是否在子帧内。 每个宏块由多个连续的块组成，并且包括用于整个宏块的任何包括块的亮度数据和色度数据。 该方法可选地解码每个包含的块的亮度数据，并忽略色度数据。 该方法仅使用在数据标记结束之前的数据或分配给该块的数据组的结束的子帧，并忽略数据标记结束之后的数据。 该方法还可以以小于子帧解码速率的全帧解码速率解码全帧的视频图像数据。 该方法优选采用数字摄像机来生成视频图像数据流和用于解码和显示的笔记本计算机。