-
公开(公告)号:US08942428B2
公开(公告)日:2015-01-27
申请号:US12475302
申请日:2009-05-29
CPC分类号: G06K9/00342 , A63F13/213 , G06F3/011 , G06F3/017 , G06F2203/012 , G06K9/00335 , G06K9/00355
摘要: A system may receive image data and capture motion with respect to a target in a physical space and recognize a gesture from the captured motion. It may be desirable to isolate aspects of captured motion to differentiate random and extraneous motions. For example, a gesture may comprise motion of a user's right arm, and it may be desirable to isolate the motion of the user's right arm and exclude an interpretation of any other motion. Thus, the isolated aspect may be the focus of the received data for gesture recognition. Alternately, the isolated aspects may be an aspect of the captured motion that is removed from consideration when identifying a gesture from the captured motion. For example, gesture filters may be modified to correspond to the user's natural lean to eliminate the effect the lean has on the registry of a motion with a gesture filter.
摘要翻译: 系统可以接收图像数据并捕获相对于物理空间中的目标物的运动,并从所捕获的运动中识别手势。 可能需要分离捕获的运动的方面以区分随机和外来运动。 例如,手势可以包括用户的右臂的运动,并且可能需要隔离用户的右臂的运动并排除任何其他运动的解释。 因此,隔离的方面可以是用于手势识别的接收数据的焦点。 替代地,孤立的方面可以是从捕获的运动识别手势时被捕获的运动的一个方面。 例如,可以修改手势滤波器以对应于用户的自然倾斜,以消除精益对具有手势滤波器的运动的注册表的影响。
-
公开(公告)号:US08253746B2
公开(公告)日:2012-08-28
申请号:US12434532
申请日:2009-05-01
申请人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
发明人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
IPC分类号: G06T13/00
CPC分类号: A63F13/213 , A63F13/42 , A63F2300/1093 , A63F2300/6045 , A63F2300/64 , A63F2300/69 , G06F3/011 , G06F3/017 , G06T13/40
摘要: It may be desirable to apply corrective data to aspects of captured image or the user-performed gesture for display of a visual representation that corresponds to the corrective data. The captured motion may be any motion in the physical space that is captured by the capture device, such as a camera. Aspects of a skeletal or mesh model of a person, that is generated based on the image data captured by the capture device, may be modified prior to animation. The modification may be made to the model generated from image data that represents a target or a target's motion, including user gestures, in the physical space. For example, certain joints of a skeletal model may be readjusted or realigned. A model of a target may be modified by applying differential correction, magnetism principles, binary snapping, confining virtual movement to defined spaces, or the like.
摘要翻译: 可能期望将校正数据应用于捕获图像的方面或用户执行的手势以显示对应于校正数据的视觉表示。 捕获的运动可以是由捕获装置捕获的物理空间中的任何运动,例如相机。 可以在动画之前修改基于捕获设备捕获的图像数据生成的人的骨骼或网格模型的方面。 可以对在物理空间中表示目标或目标的运动(包括用户手势)的图像数据生成的模型进行修改。 例如,可以重新调整或重新对准骨骼模型的某些关节。 可以通过应用差分校正,磁性原理,二进制捕捉,将虚拟运动限定到定义的空间等来修改目标的模型。
-
公开(公告)号:US20130093789A1
公开(公告)日:2013-04-18
申请号:US13692885
申请日:2012-12-03
申请人: JAMES CHIA-MING LIU , STEPHEN GILCHRIST LATTA , ANTON ANDREWS , BENJAMIN ISAAC VAUGHT , CHRISTOPHER MICHAEL NOVAK , SHERIDAN LEIGH SMALL
发明人: JAMES CHIA-MING LIU , STEPHEN GILCHRIST LATTA , ANTON ANDREWS , BENJAMIN ISAAC VAUGHT , CHRISTOPHER MICHAEL NOVAK , SHERIDAN LEIGH SMALL
IPC分类号: G09G5/377
CPC分类号: G09G5/38 , G02B27/0093 , G02B27/017 , G02B27/0172 , G02B2027/0187 , G06F3/011 , G06F3/017 , G09G5/377
摘要: Virtual images are located for display in a head-mounted display (HMD) to provide an augment reality view to an HMD wearer. Sensor data may be collected from on-board sensors provided on an HMD. Additionally, other day may be collected from external sources. Based on the collected sensor data and other data, the position and rotation of the HMD wearer's head relative to the HMD wearer's body and surrounding environment may be determined. After resolving the HMD wearer's head position, the HMD wearer's total field of view (TFOV) may be classified into regions. Virtual images may then be located in the classified TFOV regions to locate the virtual images relative to the HMD wearer's body and surrounding environment.
摘要翻译: 虚拟图像位于用于显示在头戴式显示器(HMD)中以向HMD佩戴者提供增强现实视图。 可以从HMD上提供的车载传感器收集传感器数据。 另外,另外一天可能从外部来源收集。 基于所收集的传感器数据和其他数据,可以确定HMD佩戴者的头部相对于HMD佩戴者身体和周围环境的位置和旋转。 在解决HMD佩戴者的头部位置之后,HMD佩戴者的总视野(TFOV)可以分为区域。 然后虚拟图像可以位于分类的TFOV区域中,以相对于HMD佩戴者的身体和周围环境定位虚拟图像。
-
公开(公告)号:US20120327116A1
公开(公告)日:2012-12-27
申请号:US13167113
申请日:2011-06-23
申请人: JAMES CHIA-MING LIU , STEPHEN GILCHRIST LATTA , ANTON ANDREWS , BENJAMIN ISSAC VAUGHT , CHRISTOPHER MICHAEL NOVAK , SHERIDAN LEIGH SMALL
发明人: JAMES CHIA-MING LIU , STEPHEN GILCHRIST LATTA , ANTON ANDREWS , BENJAMIN ISSAC VAUGHT , CHRISTOPHER MICHAEL NOVAK , SHERIDAN LEIGH SMALL
IPC分类号: G09G5/00
CPC分类号: G09G5/38 , G02B27/0093 , G02B27/017 , G02B27/0172 , G02B2027/0187 , G06F3/011 , G06F3/017 , G09G5/377
摘要: Virtual images are located for display in a head-mounted display (HMD) to provide an augment reality view to an HMD wearer. Sensor data may be collected from on-board sensors provided on an HMD. Additionally, other day may be collected from external sources. Based on the collected sensor data and other data, the position and rotation of the HMD wearer's head relative to the HMD wearer's body and surrounding environment may be determined. After resolving the HMD wearer's head position, the HMD wearer's total field of view (TFOV) may be classified into regions. Virtual images may then be located in the classified TFOV regions to locate the virtual images relative to the HMD wearer's body and surrounding environment.
摘要翻译: 虚拟图像位于用于显示在头戴式显示器(HMD)中以向HMD佩戴者提供增强现实视图。 可以从HMD上提供的车载传感器收集传感器数据。 另外,另外一天可能从外部来源收集。 基于所收集的传感器数据和其他数据,可以确定HMD佩戴者的头部相对于HMD佩戴者身体和周围环境的位置和旋转。 在解决HMD佩戴者的头部位置之后,HMD佩戴者的总视野(TFOV)可以分为区域。 然后虚拟图像可以位于分类的TFOV区域中,以相对于HMD佩戴者的身体和周围环境定位虚拟图像。
-
公开(公告)号:US20100277489A1
公开(公告)日:2010-11-04
申请号:US12434532
申请日:2009-05-01
申请人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
发明人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
IPC分类号: G09G5/00
CPC分类号: A63F13/213 , A63F13/42 , A63F2300/1093 , A63F2300/6045 , A63F2300/64 , A63F2300/69 , G06F3/011 , G06F3/017 , G06T13/40
摘要: It may be desirable to apply corrective data to aspects of captured image or the user-performed gesture for display of a visual representation that corresponds to the corrective data. The captured motion may be any motion in the physical space that is captured by the capture device, such as a camera. Aspects of a skeletal or mesh model of a person, that is generated based on the image data captured by the capture device, may be modified prior to animation. The modification may be made to the model generated from image data that represents a target or a target's motion, including user gestures, in the physical space. For example, certain joints of a skeletal model may be readjusted or realigned. A model of a target may be modified by applying differential correction, magnetism principles, binary snapping, confining virtual movement to defined spaces, or the like.
摘要翻译: 可能期望将校正数据应用于捕获图像的方面或用户执行的手势以显示对应于校正数据的视觉表示。 捕获的运动可以是由捕获装置捕获的物理空间中的任何运动,例如相机。 可以在动画之前修改基于捕获设备捕获的图像数据生成的人的骨骼或网格模型的方面。 可以对在物理空间中表示目标或目标的运动(包括用户手势)的图像数据生成的模型进行修改。 例如,可以重新调整或重新对准骨骼模型的某些关节。 可以通过应用差分校正,磁性原理,二进制捕捉,将虚拟运动限定到定义的空间等来修改目标的模型。
-
公开(公告)号:US09298263B2
公开(公告)日:2016-03-29
申请号:US12913345
申请日:2010-10-27
申请人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Darren Bennett
发明人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Darren Bennett
CPC分类号: G06F3/017 , G06F3/011 , G06K9/00342
摘要: A capture device may capture a user's motion and a display device may display a model that maps to the user's motion, including gestures that are applicable for control. A user may be unfamiliar with a system that maps the user's motions or not know what gestures are applicable for an executing application. A user may not understand or know how to perform gestures that are applicable for the executing application. Providing visual feedback representing instructional gesture data to the user can teach the user how to properly gesture. The visual feedback may be provided in any number of suitable ways. For example, visual feedback may be provided via ghosted images, player avatars, or skeletal representations. The system can process prerecorded or live content for displaying visual feedback representing instructional gesture data. The feedback can portray the deltas between the user's actual position and the ideal gesture position.
-
公开(公告)号:US20120293518A1
公开(公告)日:2012-11-22
申请号:US13566939
申请日:2012-08-03
申请人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
发明人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Kudo Tsunoda , Darren Alexander Bennett
IPC分类号: G06T13/00
CPC分类号: A63F13/213 , A63F13/42 , A63F2300/1093 , A63F2300/6045 , A63F2300/64 , A63F2300/69 , G06F3/011 , G06F3/017 , G06T13/40
摘要: It may be desirable to apply corrective data to aspects of captured image or the user-performed gesture for display of a visual representation that corresponds to the corrective data. The captured motion may be any motion in the physical space that is captured by the capture device, such as a camera. Aspects of a skeletal or mesh model of a person, that is generated based on the image data captured by the capture device, may be modified prior to animation. The modification may be made to the model generated from image data that represents a target or a target's motion, including user gestures, in the physical space. For example, certain joints of a skeletal model may be readjusted or realigned. A model of a target may be modified by applying differential correction, magnetism principles, binary snapping, confining virtual movement to defined spaces, or the like.
摘要翻译: 可能期望将校正数据应用于捕获图像的方面或用户执行的手势以显示对应于校正数据的视觉表示。 捕获的运动可以是由捕获装置捕获的物理空间中的任何运动,例如相机。 可以在动画之前修改基于捕获设备捕获的图像数据生成的人的骨骼或网格模型的方面。 可以对在物理空间中表示目标或目标的运动(包括用户手势)的图像数据生成的模型进行修改。 例如,可以重新调整或重新对准骨骼模型的某些关节。 可以通过应用差分校正,磁性原理,二进制捕捉,将虚拟运动限定到定义的空间等来修改目标的模型。
-
公开(公告)号:US09041623B2
公开(公告)日:2015-05-26
申请号:US13692885
申请日:2012-12-03
申请人: James Chia-Ming Liu , Stephen Gilchrist Latta , Anton Andrews , Benjamin Isaac Vaught , Christopher Michael Novak , Sheridan Leigh Martin
发明人: James Chia-Ming Liu , Stephen Gilchrist Latta , Anton Andrews , Benjamin Isaac Vaught , Christopher Michael Novak , Sheridan Leigh Martin
CPC分类号: G09G5/38 , G02B27/0093 , G02B27/017 , G02B27/0172 , G02B2027/0187 , G06F3/011 , G06F3/017 , G09G5/377
摘要: Virtual images are located for display in a head-mounted display (HMD) to provide an augment reality view to an HMD wearer. Sensor data may be collected from on-board sensors provided on an HMD. Additionally, other day may be collected from external sources. Based on the collected sensor data and other data, the position and rotation of the HMD wearer's head relative to the HMD wearer's body and surrounding environment may be determined. After resolving the HMD wearer's head position, the HMD wearer's total field of view (TFOV) may be classified into regions. Virtual images may then be located in the classified TFOV regions to locate the virtual images relative to the HMD wearer's body and surrounding environment.
摘要翻译: 虚拟图像位于用于显示在头戴式显示器(HMD)中以向HMD佩戴者提供增强现实视图。 可以从HMD上提供的车载传感器收集传感器数据。 另外,另外一天可能从外部来源收集。 基于所收集的传感器数据和其他数据,可以确定HMD佩戴者的头部相对于HMD佩戴者身体和周围环境的位置和旋转。 在解决HMD佩戴者的头部位置之后,HMD佩戴者的总视野(TFOV)可以分为区域。 然后虚拟图像可以位于分类的TFOV区域中,以相对于HMD佩戴者的身体和周围环境定位虚拟图像。
-
公开(公告)号:US20100278393A1
公开(公告)日:2010-11-04
申请号:US12475302
申请日:2009-05-29
CPC分类号: G06K9/00342 , A63F13/213 , G06F3/011 , G06F3/017 , G06F2203/012 , G06K9/00335 , G06K9/00355
摘要: A system may receive image data and capture motion with respect to a target in a physical space and recognize a gesture from the captured motion. It may be desirable to isolate aspects of captured motion to differentiate random and extraneous motions. For example, a gesture may comprise motion of a user's right arm, and it may be desirable to isolate the motion of the user's right arm and exclude an interpretation of any other motion. Thus, the isolated aspect may be the focus of the received data for gesture recognition. Alternately, the isolated aspects may be an aspect of the captured motion that is removed from consideration when identifying a gesture from the captured motion. For example, gesture filters may be modified to correspond to the user's natural lean to eliminate the effect the lean has on the registry of a motion with a gesture filter.
摘要翻译: 系统可以接收图像数据并捕获相对于物理空间中的目标物的运动,并从所捕获的运动中识别手势。 可能需要分离捕获的运动的方面以区分随机和外来运动。 例如,手势可以包括用户的右臂的运动,并且可能需要隔离用户的右臂的运动并排除任何其他运动的解释。 因此,隔离的方面可以是用于手势识别的接收数据的焦点。 替代地,孤立的方面可以是从捕获的运动识别手势时被捕获的运动的一个方面。 例如,可以修改手势滤波器以对应于用户的自然倾斜,以消除精益对具有手势滤波器的运动的注册表的影响。
-
公开(公告)号:US09377857B2
公开(公告)日:2016-06-28
申请号:US12434545
申请日:2009-05-01
申请人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Darren Bennett
发明人: Kevin Geisner , Relja Markovic , Stephen Gilchrist Latta , Gregory Nelson Snook , Darren Bennett
CPC分类号: G06F3/017 , G06F3/011 , G06K9/00342
摘要: A capture device may capture a user's motion and a display device may display a model that maps to the user's motion, including gestures that are applicable for control. A user may be unfamiliar with a system that maps the user's motions or not know what gestures are applicable for an executing application. A user may not understand or know how to perform gestures that are applicable for the executing application. Providing visual feedback representing instructional gesture data to the user can teach the user how to properly gesture. The visual feedback may be provided in any number of suitable ways. For example, visual feedback may be provided via ghosted images, player avatars, or skeletal representations. The system can process prerecorded or live content for displaying visual feedback representing instructional gesture data. The feedback can portray the deltas between the user's actual position and the ideal gesture position.
摘要翻译: 捕获设备可以捕获用户的运动,并且显示设备可以显示映射到用户的运动的模型,包括适用于控制的手势。 用户可能不熟悉映射用户的运动或不知道什么手势适用于执行应用的系统。 用户可能不了解或知道如何执行适用于执行应用程序的手势。 向用户提供表示教学手势数据的视觉反馈可以教导用户如何正确地手势。 可以以任何数量的适当方式提供视觉反馈。 例如,可以通过重影图像,玩家头像或骨骼表示来提供视觉反馈。 该系统可以处理预记录或实况内容,以显示表示教学手势数据的视觉反馈。 反馈可以描绘用户实际位置和理想手势位置之间的三角形。
-
-
-
-
-
-
-
-
-