公开(公告)号：US08514264B2

公开(公告)日：2013-08-20

申请号：US13406235

申请日：2012-02-27

申请人： Ankur Agarwal ,  Antonio Criminisi ,  William A. S. Buxton ,  Andrew Blake ,  Andrew William Fitzgibbon

发明人： Ankur Agarwal ,  Antonio Criminisi ,  William A. S. Buxton ,  Andrew Blake ,  Andrew William Fitzgibbon

IPC分类号： H04N7/15

CPC分类号： G06Q10/10 ,  H04N7/15

摘要： Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

摘要翻译： 现有的远程工作区共享系统很难使用。 例如，一个用户在公共工作产品上进行的更改通常会在远程用户查看的显示器上突然出现。 因此，互动被用户认为是不自然的，并且通常效率低下。 在第一位置从相机接收公共作品的显示的图像。 这些图像还可以包括关于显示器和相机之间的对象的信息，例如用户在平板PC上编辑文档的手。 这些图像与共享工作产品的图像组合，并在远程位置显示。 然后可以看到有关远程用户操作的高级信息，并促进用户之间的协作中介。 深度信息可以用于影响组合图像的过程。

公开(公告)号：US20080184124A1

公开(公告)日：2008-07-31

申请号：US11669107

申请日：2007-01-30

申请人： Ankur Agarwal ,  Antonio Criminisi ,  William Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

发明人： Ankur Agarwal ,  Antonio Criminisi ,  William Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

IPC分类号： G06F3/048

CPC分类号： G06Q10/10 ,  H04N7/15

摘要： Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

摘要翻译： 现有的远程工作区共享系统很难使用。 例如，一个用户在公共工作产品上进行的更改通常会在远程用户查看的显示器上突然出现。 因此，互动被用户认为是不自然的，并且通常效率低下。 在第一位置从相机接收公共作品的显示的图像。 这些图像还可以包括关于显示器和相机之间的对象的信息，例如用户在平板PC上编辑文档的手。 这些图像与共享工作产品的图像组合，并在远程位置显示。 然后可以看到有关远程用户操作的高级信息，并促进用户之间的协作中介。 深度信息可以用于影响组合图像的过程。

公开(公告)号：US20120162354A1

公开(公告)日：2012-06-28

申请号：US13406235

申请日：2012-02-27

申请人： Ankur Agarwal ,  Antonio Criminisi ,  William Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

发明人： Ankur Agarwal ,  Antonio Criminisi ,  William Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

IPC分类号： H04N7/15

CPC分类号： G06Q10/10 ,  H04N7/15

摘要： Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

摘要翻译： 现有的远程工作区共享系统很难使用。 例如，一个用户在公共工作产品上进行的更改通常会在远程用户查看的显示器上突然出现。 因此，互动被用户认为是不自然的，并且通常效率低下。 在第一位置从相机接收公共作品的显示的图像。 这些图像还可以包括关于显示器和相机之间的对象的信息，例如用户在平板PC上编辑文档的手。 这些图像与共享工作产品的图像组合，并在远程位置显示。 然后可以看到有关远程用户操作的高级信息，并促进用户之间的协作中介。 深度信息可以用于影响组合图像的过程。

公开(公告)号：US08125510B2

公开(公告)日：2012-02-28

申请号：US11669107

申请日：2007-01-30

申请人： Ankur Agarwal ,  Antonio Criminisi ,  Bill Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

发明人： Ankur Agarwal ,  Antonio Criminisi ,  Bill Buxton ,  Andrew Blake ,  Andrew Fitzgibbon

IPC分类号： H04N7/14

CPC分类号： G06Q10/10 ,  H04N7/15

摘要： Existing remote workspace sharing systems are difficult to use. For example, changes made on a common work product by one user often appear abruptly on displays viewed by remote users. As a result the interaction is perceived as unnatural by the users and is often inefficient. Images of a display of a common work product are received from a camera at a first location. These images may also comprise information about objects between the display and the camera such as a user's hand editing a document on a tablet PC. These images are combined with images of the shared work product and displayed at remote locations. Advance information about remote user actions is then visible and facilitates collaborative mediation between users. Depth information may be used to influence the process of combining the images.

摘要翻译： 现有的远程工作区共享系统很难使用。 例如，一个用户在公共工作产品上进行的更改通常会在远程用户查看的显示器上突然出现。 因此，互动被用户认为是不自然的，并且通常效率低下。 在第一位置从相机接收公共作品的显示的图像。 这些图像还可以包括关于显示器和相机之间的对象的信息，例如用户在平板PC上编辑文档的手。 这些图像与共享工作产品的图像组合，并在远程位置显示。 然后可以看到有关远程用户操作的高级信息，并促进用户之间的协作中介。 深度信息可以用于影响组合图像的过程。

公开(公告)号：US08638985B2

公开(公告)日：2014-01-28

申请号：US13040205

申请日：2011-03-03

申请人： Jamie Daniel Joseph Shotton ,  Shahram Izadi ,  Otmar Hilliges ,  David Kim ,  David Geoffrey Molyneaux ,  Matthew Darius Cook ,  Pushmeet Kohli ,  Antonio Criminisi ,  Ross Brook Girshick ,  Andrew William Fitzgibbon

发明人： Jamie Daniel Joseph Shotton ,  Shahram Izadi ,  Otmar Hilliges ,  David Kim ,  David Geoffrey Molyneaux ,  Matthew Darius Cook ,  Pushmeet Kohli ,  Antonio Criminisi ,  Ross Brook Girshick ,  Andrew William Fitzgibbon

IPC分类号： G06K9/00

CPC分类号： G06K9/00369

摘要： Techniques for human body pose estimation are disclosed herein. Images such as depth images, silhouette images, or volumetric images may be generated and pixels or voxels of the images may be identified. The techniques may process the pixels or voxels to determine a probability that each pixel or voxel is associated with a segment of a body captured in the image or to determine a three-dimensional representation for each pixel or voxel that is associated with a location on a canonical body. These probabilities or three-dimensional representations may then be utilized along with the images to construct a posed model of the body captured in the image.

摘要翻译： 本文公开了人体姿势估计技术。 可以生成诸如深度图像，剪影图像或体积图像的图像，并且可以识别图像的像素或体素。 这些技术可以处理像素或体素以确定每个像素或体素与在图像中捕获的身体的片段相关联的概率，或者确定与每个像素或体素上的位置相关联的每个像素或体素的三维表示 规范身体。 然后可以将这些概率或三维表示与图像一起使用以构建在图像中捕获的身体的姿态模型。

公开(公告)号：US20110210915A1

公开(公告)日：2011-09-01

申请号：US13040205

申请日：2011-03-03

申请人： Jamie Daniel Joseph Shotton ,  Shahram Izadi ,  Otmar Hilliges ,  David Kim ,  David Geoffrey Molyneaux ,  Matthew Darius Cook ,  Pushmeet Kohli ,  Antonio Criminisi ,  Ross Brook Girshick ,  Andrew William Fitzgibbon

发明人： Jamie Daniel Joseph Shotton ,  Shahram Izadi ,  Otmar Hilliges ,  David Kim ,  David Geoffrey Molyneaux ,  Matthew Darius Cook ,  Pushmeet Kohli ,  Antonio Criminisi ,  Ross Brook Girshick ,  Andrew William Fitzgibbon

IPC分类号： G06K9/00 ,  G06F3/033

CPC分类号： G06K9/00369

摘要： Techniques for human body pose estimation are disclosed herein. Images such as depth images, silhouette images, or volumetric images may be generated and pixels or voxels of the images may be identified. The techniques may process the pixels or voxels to determine a probability that each pixel or voxel is associated with a segment of a body captured in the image or to determine a three-dimensional representation for each pixel or voxel that is associated with a location on a canonical body. These probabilities or three-dimensional representations may then be utilized along with the images to construct a posed model of the body captured in the image.

摘要翻译： 本文公开了人体姿势估计技术。 可以生成诸如深度图像，剪影图像或体积图像的图像，并且可以识别图像的像素或体素。 这些技术可以处理像素或体素以确定每个像素或体素与在图像中捕获的身体的片段相关联的概率，或者确定与每个像素或体素上的位置相关联的每个像素或体素的三维表示 规范身体。 然后可以将这些概率或三维表示与图像一起使用以构建在图像中捕获的身体的姿态模型。

公开(公告)号：US08103109B2

公开(公告)日：2012-01-24

申请号：US11765264

申请日：2007-06-19

申请人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

发明人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

IPC分类号： G06K9/62

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06F3/0425 ,  G06K9/6282

摘要： There is a need to provide simple, accurate, fast and computationally inexpensive methods of object and hand pose recognition for many applications. For example, to enable a user to make use of his or her hands to drive an application either displayed on a tablet screen or projected onto a table top. There is also a need to be able to discriminate accurately between events when a user's hand or digit touches such a display from events when a user's hand or digit hovers just above that display. A random decision forest is trained to enable recognition of hand poses and objects and optionally also whether those hand poses are touching or not touching a display surface. The random decision forest uses image features such as appearance, shape and optionally stereo image features. In some cases, the training process is cost aware. The resulting recognition system is operable in real-time.

摘要翻译： 需要为许多应用提供简单，准确，快速和计算上便宜的对象和手姿态识别方法。 例如，为了使用户能够利用他或她的手来驱动显示在平板电脑屏幕上或投影到桌面上的应用程序。 当用户的手或数字在该显示器的正上方移动时，当用户的手或数字触发这样的显示时，还需要能够精确地区分事件之间的事件。 训练随机决策林以识别手姿势和物体，并且还可以选择性地确定那些手姿势是触摸还是不接触显示表面。 随机决策林使用图像特征，如外观，形状和可选的立体图像特征。 在某些情况下，培训过程是意识到成本。 所得到的识别系统可以实时操作。

公开(公告)号：US20120087575A1

公开(公告)日：2012-04-12

申请号：US13326166

申请日：2011-12-14

申请人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

发明人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

IPC分类号： G06K9/62

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06F3/0425 ,  G06K9/6282

摘要： There is a need to provide simple, accurate, fast and computationally inexpensive methods of object and hand pose recognition for many applications. For example, to enable a user to make use of his or her hands to drive an application either displayed on a tablet screen or projected onto a table top. There is also a need to be able to discriminate accurately between events when a user's hand or digit touches such a display from events when a user's hand or digit hovers just above that display. A random decision forest is trained to enable recognition of hand poses and objects and optionally also whether those hand poses are touching or not touching a display surface. The random decision forest uses image features such as appearance, shape and optionally stereo image features. In some cases, the training process is cost aware. The resulting recognition system is operable in real-time.

摘要翻译： 需要为许多应用提供简单，准确，快速和计算上便宜的对象和手姿态识别方法。 例如，为了使用户能够利用他或她的手来驱动显示在平板电脑屏幕上或投影到桌面上的应用程序。 当用户的手或数字在该显示器的正上方移动时，当用户的手或数字触发这样的显示时，还需要能够精确地区分事件之间的事件。 对随机决策林进行训练，以便能够识别手姿势和物体，并且可选地还可以确定那些手姿势是触摸还是不接触显示表面。 随机决策林使用图像特征，如外观，形状和可选的立体图像特征。 在某些情况下，培训过程是意识到成本。 所得到的识别系统可以实时操作。

公开(公告)号：US20080317331A1

公开(公告)日：2008-12-25

申请号：US11765264

申请日：2007-06-19

申请人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

发明人： John Winn ,  Antonio Criminisi ,  Ankur Agarwal ,  Thomas Deselaers

IPC分类号： G06K9/00

CPC分类号： G06K9/00355 ,  G06F3/017 ,  G06F3/0425 ,  G06K9/6282

摘要： There is a need to provide simple, accurate, fast and computationally inexpensive methods of object and hand pose recognition for many applications. For example, to enable a user to make use of his or her hands to drive an application either displayed on a tablet screen or projected onto a table top. There is also a need to be able to discriminate accurately between events when a user's hand or digit touches such a display from events when a user's hand or digit hovers just above that display. A random decision forest is trained to enable recognition of hand poses and objects and optionally also whether those hand poses are touching or not touching a display surface. The random decision forest uses image features such as appearance, shape and optionally stereo image features. In some cases, the training process is cost aware. The resulting recognition system is operable in real-time.

摘要翻译： 需要为许多应用提供简单，准确，快速和计算上便宜的对象和手姿态识别方法。 例如，为了使用户能够利用他或她的手来驱动显示在平板电脑屏幕上或投影到桌面上的应用程序。 当用户的手或数字在该显示器的正上方移动时，当用户的手或数字触发这样的显示时，还需要能够精确地区分事件之间的事件。 对随机决策林进行训练，以便能够识别手姿势和物体，并且还可以选择地确定那些手姿势是否触及或不接触显示表面。 随机决策林使用图像特征，如外观，形状和可选的立体图像特征。 在某些情况下，培训过程是意识到成本。 所得到的识别系统可以实时操作。

公开(公告)号：US20110274352A1

公开(公告)日：2011-11-10

申请号：US12776082

申请日：2010-05-07

申请人： Andrew Blake ,  Varun Gulshan ,  Carsten Rother ,  Antonio Criminisi

发明人： Andrew Blake ,  Varun Gulshan ,  Carsten Rother ,  Antonio Criminisi

IPC分类号： G06K9/34

CPC分类号： G06T7/11 ,  G06T7/194 ,  G06T2207/20101 ,  G06T2207/20168

摘要： Image segmentation using star-convexity constraints is described. In an example, user input specifies positions of one or more star centers in a foreground to be segmented from a background of an image. In embodiments, an energy function is used to express the problem of segmenting the image and that energy function incorporates a star-convexity constraint which limits the number of possible solutions. For example, the star-convexity constraint may be that, for any point p inside the foreground, all points on a shortest path (which may be geodesic or Euclidean) between the nearest star center and p also lie inside the foreground. In some examples continuous star centers such as lines are used. In embodiments a user may iteratively edit the star centers by adding brush strokes to the image in order to progressively change the star-convexity constraints and obtain an accurate segmentation.

摘要翻译： 描述了使用星形凸度约束的图像分割。 在一个示例中，用户输入指定要从图像的背景分割的前景中的一个或多个星形中心的位置。 在实施例中，能量函数用于表示分割图像的问题，并且能量函数包含限制可能解决方案数量的星形 - 凸度约束。 例如，星凸约束可以是，对于前景中的任何点p，最近的星中心和p之间的最短路径上的所有点（可以是测地线或欧几里德）也位于前景内。 在一些示例中，使用诸如线的连续星形中心。 在实施例中，用户可以通过向图像中添加画笔笔触来迭代地编辑星形中心，以逐渐改变星形凸度约束并获得准确的分割。