公开(公告)号：US08131012B2

公开(公告)日：2012-03-06

申请号：US12028484

申请日：2008-02-08

申请人： John Eric Eaton ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

发明人： John Eric Eaton ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

IPC分类号： G06K9/00

CPC分类号： G06K9/00771 ,  G08B13/19608 ,  G08B13/19613

摘要： Embodiments of the present invention provide a method and a system for analyzing and learning behavior based on an acquired stream of video frames. Objects depicted in the stream are determined based on an analysis of the video frames. Each object may have a corresponding search model used to track an object's motion frame-to-frame. Classes of the objects are determined and semantic representations of the objects are generated. The semantic representations are used to determine objects' behaviors and to learn about behaviors occurring in an environment depicted by the acquired video streams. This way, the system learns rapidly and in real-time normal and abnormal behaviors for any environment by analyzing movements or activities or absence of such in the environment and identifies and predicts abnormal and suspicious behavior based on what has been learned.

摘要翻译： 本发明的实施例提供了一种基于所获取的视频帧流来分析和学习行为的方法和系统。 基于对视频帧的分析来确定流中描绘的对象。 每个对象可以具有用于跟踪对象的帧到帧的运动的对应的搜索模型。 确定对象的类，并生成对象的语义表示。 语义表示用于确定对象的行为，并了解在所获取的视频流中描绘的环境中发生的行为。 通过这种方式，系统通过分析环境中的动作或活动或不存在这些环境，快速，实时地对任何环境的正常和异常行为进行学习，并根据所学到的知识和预测异常和可疑行为。

公开(公告)号：US08797405B2

公开(公告)日：2014-08-05

申请号：US12551332

申请日：2009-08-31

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  Gang Xu

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  Gang Xu

IPC分类号： H04N7/18 ,  G06K9/00

CPC分类号： G06K9/00771 ,  G06K9/00973

摘要： Techniques are disclosed for visually conveying classifications derived from pixel-level micro-features extracted from image data. The image data may include an input stream of video frames depicting one or more foreground objects. The classifications represent information learned by a video surveillance system. A request may be received to view a classification. A visual representation of the classification may be generated. A user interface may be configured to display the visual representation of the classification and to allow a user to view and/or modify properties associated with the classification.

摘要翻译： 公开了用于视觉地传送从图像数据提取的像素级微特征得出的分类的技术。 图像数据可以包括描绘一个或多个前景对象的视频帧的输入流。 分类表示视频监控系统学到的信息。 可以接收到查看分类的请求。 可以生成分类的视觉表示。 用户界面可以被配置为显示分类的可视表示，并允许用户查看和/或修改与分类相关联的属性。

公开(公告)号：US08620028B2

公开(公告)日：2013-12-31

申请号：US13413549

申请日：2012-03-06

申请人： John Eric Eaton ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

发明人： John Eric Eaton ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

IPC分类号： G06K9/62

CPC分类号： G06K9/00771 ,  G08B13/19608 ,  G08B13/19613

摘要： Embodiments of the present invention provide a method and a system for analyzing and learning behavior based on an acquired stream of video frames. Objects depicted in the stream are determined based on an analysis of the video frames. Each object may have a corresponding search model used to track an object's motion frame-to-frame. Classes of the objects are determined and semantic representations of the objects are generated. The semantic representations are used to determine objects' behaviors and to learn about behaviors occurring in an environment depicted by the acquired video streams. This way, the system learns rapidly and in real-time normal and abnormal behaviors for any environment by analyzing movements or activities or absence of such in the environment and identifies and predicts abnormal and suspicious behavior based on what has been learned.

摘要翻译： 本发明的实施例提供了一种基于所获取的视频帧流来分析和学习行为的方法和系统。 基于对视频帧的分析来确定流中描绘的对象。 每个对象可以具有用于跟踪对象的帧到帧的运动的对应的搜索模型。 确定对象的类，并生成对象的语义表示。 语义表示用于确定对象的行为，并了解在所获取的视频流中描绘的环境中发生的行为。 通过这种方式，系统通过分析环境中的动作或活动或不存在这些环境，快速，实时地对任何环境的正常和异常行为进行学习，并根据所学到的知识和预测异常和可疑行为。

公开(公告)号：US08280153B2

公开(公告)日：2012-10-02

申请号：US12543242

申请日：2009-08-18

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow ,  Gang Xu

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow ,  Gang Xu

IPC分类号： G06K9/00

CPC分类号： G06T11/206

摘要： Techniques are disclosed for visually conveying a trajectory map. The trajectory map provides users with a visualization of data observed by a machine-learning engine of a behavior recognition system. Further, the visualization may provide an interface used to guide system behavior. For example, the interface may be used to specify that the behavior recognition system should alert (or not alert) when a particular trajectory is observed to occur.

摘要翻译： 公开了用于视觉地传送轨迹图的技术。 轨迹图为用户提供行为识别系统的机器学习引擎所观察到的数据可视化。 此外，可视化可以提供用于指导系统行为的接口。 例如，接口可以用于指定当观察到特定轨迹发生时行为识别系统应该警告（或不警报）。

公开(公告)号：US20110050897A1

公开(公告)日：2011-03-03

申请号：US12551332

申请日：2009-08-31

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  Gang Xu

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  Gang Xu

IPC分类号： H04N7/16

CPC分类号： G06K9/00771 ,  G06K9/00973

摘要： Techniques are disclosed for visually conveying classifications derived from pixel-level micro-features extracted from image data. The image data may include an input stream of video frames depicting one or more foreground objects. The classifications represent information learned by a video surveillance system. A request may be received to view a classification. A visual representation of the classification may be generated. A user interface may be configured to display the visual representation of the classification and to allow a user to view and/or modify properties associated with the classification.

摘要翻译： 公开了用于视觉地传送从图像数据提取的像素级微特征得出的分类的技术。 图像数据可以包括描绘一个或多个前景对象的视频帧的输入流。 分类表示视频监控系统学到的信息。 可能会收到请求以查看分类。 可以生成分类的视觉表示。 用户界面可以被配置为显示分类的可视表示，并允许用户查看和/或修改与分类相关联的属性。

公开(公告)号：US20080193010A1

公开(公告)日：2008-08-14

申请号：US12028484

申请日：2008-02-08

申请人： JOHN ERIC EATON ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

发明人： JOHN ERIC EATON ,  Wesley Kenneth Cobb ,  Dennis Gene Urech ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Lon William Risinger ,  Kishor Adinath Saitwal ,  Ming-Jung Seow ,  David Marvin Solum ,  Gang Xu ,  Tao Yang

IPC分类号： G06F15/18

CPC分类号： G06K9/00771 ,  G08B13/19608 ,  G08B13/19613

摘要： Embodiments of the present invention provide a method and a system for analyzing and learning behavior based on an acquired stream of video frames. Objects depicted in the stream are determined based on an analysis of the video frames. Each object may have a corresponding search model used to track an object's motion frame-to-frame. Classes of the objects are determined and semantic representations of the objects are generated. The semantic representations are used to determine objects' behaviors and to learn about behaviors occurring in an environment depicted by the acquired video streams. This way, the system learns rapidly and in real-time normal and abnormal behaviors for any environment by analyzing movements or activities or absence of such in the environment and identifies and predicts abnormal and suspicious behavior based on what has been learned.

摘要翻译： 本发明的实施例提供了一种基于所获取的视频帧流来分析和学习行为的方法和系统。 基于对视频帧的分析来确定流中描绘的对象。 每个对象可以具有用于跟踪对象的帧到帧的运动的对应的搜索模型。 确定对象的类，并生成对象的语义表示。 语义表示用于确定对象的行为，并了解在所获取的视频流中描绘的环境中发生的行为。 通过这种方式，系统通过分析环境中的动作或活动或不存在这些环境，快速，实时地对任何环境的正常和异常行为进行学习，并根据所学到的知识和预测异常和可疑行为。

公开(公告)号：US08625884B2

公开(公告)日：2014-01-07

申请号：US12543204

申请日：2009-08-18

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow

IPC分类号： G06K9/66 ,  G06T7/00 ,  H04N7/18

CPC分类号： G06K9/00771 ,  G08B13/19613

摘要： Techniques are disclosed for visually conveying an event map. The event map may represent information learned by a surveillance system. A request may be received to view the event map for a specified scene. The event map may be generated, including a background model of the specified scene and at least one cluster providing a statistical distribution of an event in the specified scene. Each statistical distribution may be derived from data streams generated from a sequence of video frames depicting the specified scene captured by a video camera. Each event may be observed to occur at a location in the specified scene corresponding to a location of the respective cluster in the event map. The event map may be configured to allow a user to view and/or modify properties associated with each cluster. For example, the user may label a cluster and set events matching the cluster to always (or never) generate an alert.

摘要翻译： 公开了用于视觉传达事件图的技术。 事件地图可以表示监视系统学到的信息。 可以接收到查看指定场景的事件映射的请求。 可以生成事件映射，包括指定场景的背景模型和至少一个提供指定场景中的事件的统计分布的群集。 每个统计分布可以从从描述由摄像机捕获的指定场景的视频帧序列产生的数据流中导出。 可以观察每个事件发生在与事件映射中相应簇的位置相对应的指定场景中的位置处。 可以将事件映射配置为允许用户查看和/或修改与每个集群相关联的属性。 例如，用户可以标记集群并将与集群匹配的事件设置为始终（或从不）生成警报。

公开(公告)号：US08786702B2

公开(公告)日：2014-07-22

申请号：US12551303

申请日：2009-08-31

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  Rajkiran Kumar Gottumukkal ,  Ming-Jung Seow

IPC分类号： H04N7/18

CPC分类号： G06K9/6217 ,  G06K9/00771 ,  G06K9/00973 ,  H04N7/18 ,  H04N7/183

摘要： Techniques are disclosed for visually conveying a percept. The percept may represent information learned by a video surveillance system. A request may be received to view a percept for a specified scene. The percept may have been derived from data streams generated from a sequence of video frames depicting the specified scene captured by a video camera. A visual representation of the percept may be generated. A user interface may be configured to display the visual representation of the percept and to allow a user to view and/or modify metadata attributes with the percept. For example, the user may label a percept and set events matching the percept to always (or never) result in alert being generated for users of the video surveillance system.

摘要翻译： 公开了用于视觉地传达感知的技术。 感知可以表示视频监控系统学到的信息。 可以接收请求以查看指定场景的感知。 感知可能是从描绘由摄像机捕获的指定场景的视频帧序列产生的数据流导出的。 可以产生视觉的视觉表示。 用户界面可以被配置为显示感知的视觉表示，并允许用户使用感知来查看和/或修改元数据属性。 例如，用户可以标记感知并将匹配感知的事件设置为始终（或从不）导致为视频监控系统的用户生成警报。

公开(公告)号：US08493409B2

公开(公告)日：2013-07-23

申请号：US12543351

申请日：2009-08-18

申请人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal

发明人： Wesley Kenneth Cobb ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal

IPC分类号： G09G5/14 ,  G06T17/05 ,  G06T15/04 ,  G06T11/00 ,  G06T15/08

CPC分类号： G06T17/05 ,  G06K9/00771 ,  G06K9/6251 ,  G06T7/194 ,  G06T7/215 ,  G06T11/00 ,  G06T11/206 ,  G06T15/04 ,  G06T15/08 ,  G06T2207/20084 ,  H04N5/272

摘要： Techniques are disclosed for visually conveying a sequence storing an ordered string of symbols generated from kinematic data derived from analyzing an input stream of video frames depicting one or more foreground objects. The sequence may represent information learned by a video surveillance system. A request may be received to view the sequence or a segment partitioned form the sequence. A visual representation of the segment may be generated and superimposed over a background image associated with the scene. A user interface may be configured to display the visual representation of the sequence or segment and to allow a user to view and/or modify properties associated with the sequence or segment.

摘要翻译： 公开了用于视觉地传达存储从分析描绘一个或多个前景对象的视频帧的输入流导出的运动学数据产生的符号的有序串的序列的技术。 序列可以表示由视频监控系统学习的信息。 可以接收请求以查看序列或从序列分割的段。 可以生成片段的视觉表示并叠加在与场景相关联的背景图像上。 用户界面可以被配置为显示序列或段的可视表示，并且允许用户查看和/或修改与序列或段相关联的属性。

公开(公告)号：US20110043536A1

公开(公告)日：2011-02-24

申请号：US12543351

申请日：2009-08-18

申请人： WESLEY KENNETH COBB ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal

发明人： WESLEY KENNETH COBB ,  Bobby Ernest Blythe ,  David Samuel Friedlander ,  Rajkiran Kumar Gottumukkal ,  Kishor Adinath Saitwal

IPC分类号： G09G5/00

CPC分类号： G06T17/05 ,  G06K9/00771 ,  G06K9/6251 ,  G06T7/194 ,  G06T7/215 ,  G06T11/00 ,  G06T11/206 ,  G06T15/04 ,  G06T15/08 ,  G06T2207/20084 ,  H04N5/272

摘要： Techniques are disclosed for visually conveying a sequence storing an ordered string of symbols generated from kinematic data derived from analyzing an input stream of video frames depicting one or more foreground objects. The sequence may represent information learned by a video surveillance system. A request may be received to view the sequence or a segment partitioned form the sequence. A visual representation of the segment may be generated and superimposed over a background image associated with the scene. A user interface may be configured to display the visual representation of the sequence or segment and to allow a user to view and/or modify properties associated with the sequence or segment.

摘要翻译： 公开了用于视觉地传达存储从分析描绘一个或多个前景对象的视频帧的输入流导出的运动学数据产生的符号的有序串的序列的技术。 序列可以表示由视频监控系统学习的信息。 可以接收请求以查看序列或从序列分割的段。 可以生成片段的视觉表示并叠加在与场景相关联的背景图像上。 用户界面可以被配置为显示序列或段的可视表示，并且允许用户查看和/或修改与序列或段相关联的属性。