Systems and methods for estimating a non-visible or occluded body part
    21.
    发明授权
    Systems and methods for estimating a non-visible or occluded body part 有权
    用于估计不可见或闭塞的身体部位的系统和方法

    公开(公告)号:US09182814B2

    公开(公告)日:2015-11-10

    申请号:US12492457

    申请日:2009-06-26

    IPC分类号: G06K9/00 G06F3/01

    CPC分类号: G06F3/011 G06K9/00369

    摘要: A depth image of a scene may be received, observed, or captured by a device. The depth image may include a human target that may have, for example, a portion thereof non-visible or occluded. For example, a user may be turned such that a body part may not be visible to the device, may have one or more body parts partially outside a field of view of the device, may have a body part or a portion of a body part behind another body part or object, or the like such that the human target associated with the user may also have a portion body part or a body part non-visible or occluded in the depth image. A position or location of the non-visible or occluded portion or body part of the human target associated with the user may then be estimated.

    摘要翻译: 场景的深度图像可以被设备接收,观察或捕获。 深度图像可以包括可能具有例如其不可见或遮挡的部分的人类靶标。 例如,用户可以被转动使得身体部分可能对于设备可能不可见,可以具有部分在设备的视场外部的一个或多个身体部位,可以具有主体部分或身体部分的一部分 在另一身体部分或物体等之后,使得与使用者相关联的人类目标也可以具有在深度图像中不可见或闭塞的部分主体部分或身体部分。 然后可以估计与用户相关联的人类目标的不可见或遮挡的部分或身体部分的位置或位置。

    SYSTEMS AND METHODS FOR IMMERSIVE INTERACTION WITH VIRTUAL OBJECTS
    22.
    发明申请
    SYSTEMS AND METHODS FOR IMMERSIVE INTERACTION WITH VIRTUAL OBJECTS 审中-公开
    与虚拟对象密切相关的系统和方法

    公开(公告)号:US20110279249A1

    公开(公告)日:2011-11-17

    申请号:US13192305

    申请日:2011-07-27

    IPC分类号: G08B6/00

    摘要: A system to present the user a 3-D virtual environment as well as non-visual sensory feedback for interactions that user makes with virtual objects in that environment is disclosed. In an exemplary embodiment, a system comprising a depth camera that captures user position and movement, a three-dimensional (3-D) display device that presents the user a virtual environment in 3-D and a haptic feedback device provides haptic feedback to the user as he interacts with a virtual object in the virtual environment. As the user moves through his physical space, he is captured by the depth camera. Data from that depth camera is parsed to correlate a user position with a position in the virtual environment. Where the user position or movement causes the user to touch the virtual object, that is determined, and corresponding haptic feedback is provided to the user.

    摘要翻译: 公开了一种向用户呈现用户与该环境中的虚拟对象进行交互的三维虚拟环境以及非视觉感觉反馈的系统。 在示例性实施例中,包括捕获用户位置和移动的深度相机的系统,向3D中呈现用户虚拟环境的三维(3-D)显示设备和触觉反馈设备向触摸反馈设备提供触觉反馈 用户在虚拟环境中与虚拟对象进行交互。 随着用户移动他的物理空间,他被深度摄像机捕获。 解析来自该深度相机的数据以将用户位置与虚拟环境中的位置相关联。 在用户位置或移动导致用户触摸虚拟对象的情况下,确定该对象,并且向用户提供对应的触觉反馈。

    Systems and methods for immersive interaction with virtual objects
    23.
    发明授权
    Systems and methods for immersive interaction with virtual objects 有权
    与虚拟对象进行沉浸式互动的系统和方法

    公开(公告)号:US08009022B2

    公开(公告)日:2011-08-30

    申请号:US12834723

    申请日:2010-07-12

    IPC分类号: H04B3/36

    摘要: A system to present the user a 3-D virtual environment as well as non-visual sensory feedback for interactions that user makes with virtual objects in that environment is disclosed. In an exemplary embodiment, a system comprising a depth camera that captures user position and movement, a three-dimensional (3-D) display device that presents the user a virtual environment in 3-D and a haptic feedback device provides haptic feedback to the user as he interacts with a virtual object in the virtual environment. As the user moves through his physical space, he is captured by the depth camera. Data from that depth camera is parsed to correlate a user position with a position in the virtual environment. Where the user position or movement causes the user to touch the virtual object, that is determined, and corresponding haptic feedback is provided to the user.

    摘要翻译: 公开了一种向用户呈现用户与该环境中的虚拟对象进行交互的三维虚拟环境以及非视觉感觉反馈的系统。 在示例性实施例中,包括捕获用户位置和移动的深度相机的系统,向3D中呈现用户虚拟环境的三维(3-D)显示设备和触觉反馈设备向触摸反馈设备提供触觉反馈 用户在虚拟环境中与虚拟对象进行交互。 随着用户移动他的物理空间,他被深度摄像机捕获。 解析来自该深度相机的数据以将用户位置与虚拟环境中的位置相关联。 在用户位置或移动导致用户触摸虚拟对象的情况下,确定该对象,并且向用户提供对应的触觉反馈。

    SYSTEMS AND METHODS FOR IMMERSIVE INTERACTION WITH VIRTUAL OBJECTS
    24.
    发明申请
    SYSTEMS AND METHODS FOR IMMERSIVE INTERACTION WITH VIRTUAL OBJECTS 有权
    与虚拟对象密切相关的系统和方法

    公开(公告)号:US20100302015A1

    公开(公告)日:2010-12-02

    申请号:US12834723

    申请日:2010-07-12

    IPC分类号: H04B3/36 G06T15/00

    摘要: A system to present the user a 3-D virtual environment as well as non-visual sensory feedback for interactions that user makes with virtual objects in that environment is disclosed. In an exemplary embodiment, a system comprising a depth camera that captures user position and movement, a three-dimensional (3-D) display device that presents the user a virtual environment in 3-D and a haptic feedback device provides haptic feedback to the user as he interacts with a virtual object in the virtual environment. As the user moves through his physical space, he is captured by the depth camera. Data from that depth camera is parsed to correlate a user position with a position in the virtual environment. Where the user position or movement causes the user to touch the virtual object, that is determined, and corresponding haptic feedback is provided to the user.

    摘要翻译: 公开了一种向用户呈现用户与该环境中的虚拟对象进行交互的三维虚拟环境以及非视觉感觉反馈的系统。 在示例性实施例中,包括捕获用户位置和移动的深度相机的系统,向3D中呈现用户虚拟环境的三维(3-D)显示设备和触觉反馈设备向触摸反馈设备提供触觉反馈 用户在虚拟环境中与虚拟对象进行交互。 随着用户移动他的物理空间,他被深度摄像机捕获。 解析来自该深度相机的数据以将用户位置与虚拟环境中的位置相关联。 在用户位置或移动导致用户触摸虚拟对象的情况下,确定该对象,并且向用户提供对应的触觉反馈。

    Systems And Methods For Estimating An Occluded Body Part
    25.
    发明申请
    Systems And Methods For Estimating An Occluded Body Part 有权
    用于估计封闭身体部位的系统和方法

    公开(公告)号:US20100303302A1

    公开(公告)日:2010-12-02

    申请号:US12492457

    申请日:2009-06-26

    IPC分类号: G06K9/00 G06F3/033

    CPC分类号: G06F3/011 G06K9/00369

    摘要: A depth image of a scene may be received, observed, or captured by a device. The depth image may include a human target that may have, for example, a portion thereof non-visible or occluded. For example, a user may be turned such that a body part may not be visible to the device, may have one or more body parts partially outside a field of view of the device, may have a body part or a portion of a body part behind another body part or object, or the like such that the human target associated with the user may also have a portion body part or a body part non-visible or occluded in the depth image. A position or location of the non-visible or occluded portion or body part of the human target associated with the user may then be estimated.

    摘要翻译: 场景的深度图像可以被设备接收,观察或捕获。 深度图像可以包括可能具有例如其不可见或遮挡的部分的人类靶标。 例如,用户可以被转动使得身体部分可能对于设备可能不可见,可以具有部分在设备的视场外部的一个或多个身体部位,可以具有主体部分或身体部分的一部分 在另一身体部分或物体等之后,使得与使用者相关联的人类目标也可以具有在深度图像中不可见或闭塞的部分主体部分或身体部分。 然后可以估计与用户相关联的人类目标的不可见或遮挡的部分或身体部分的位置或位置。

    Mapping a natural input device to a legacy system
    26.
    发明授权
    Mapping a natural input device to a legacy system 有权
    将自然输入设备映射到传统系统

    公开(公告)号:US08448094B2

    公开(公告)日:2013-05-21

    申请号:US12411276

    申请日:2009-03-25

    IPC分类号: G60F3/033 A60F9/024

    摘要: Systems and methods for mapping natural input devices to legacy system inputs are disclosed. One example system may include a computing device having an algorithmic preprocessing module configured to receive input data containing a natural user input and to identify the natural user input in the input data. The computing device may further include a gesture module coupled to the algorithmic preprocessing module, the gesture module being configured to associate the natural user input to a gesture in a gesture library. The computing device may also include a mapping module to map the gesture to a legacy controller input, and to send the legacy controller input to a legacy system in response to the natural user input.

    摘要翻译: 公开了将自然输入设备映射到传统系统输入的系统和方法。 一个示例性系统可以包括具有算法预处理模块的计算设备,其被配置为接收包含自然用户输入的输入数据并识别输入数据中的自然用户输入。 计算设备还可以包括耦合到算法预处理模块的手势模块,所述手势模块被配置为将自然用户输入与手势库中的手势相关联。 计算设备还可以包括映射模块以将手势映射到传统控制器输入,并且响应于自然用户输入将遗留控制器输入发送到传统系统。

    MAPPING A NATURAL INPUT DEVICE TO A LEGACY SYSTEM
    27.
    发明申请
    MAPPING A NATURAL INPUT DEVICE TO A LEGACY SYSTEM 有权
    将自然输入设备映射到隐藏系统

    公开(公告)号:US20100199229A1

    公开(公告)日:2010-08-05

    申请号:US12411276

    申请日:2009-03-25

    IPC分类号: G06F3/048 G06F17/30

    摘要: Systems and methods for mapping natural input devices to legacy system inputs are disclosed. One example system may include a computing device having an algorithmic preprocessing module configured to receive input data containing a natural user input and to identify the natural user input in the input data. The computing device may further include a gesture module coupled to the algorithmic preprocessing module, the gesture module being configured to associate the natural user input to a gesture in a gesture library. The computing device may also include a mapping module to map the gesture to a legacy controller input, and to send the legacy controller input to a legacy system in response to the natural user input.

    摘要翻译: 公开了将自然输入设备映射到传统系统输入的系统和方法。 一个示例性系统可以包括具有算法预处理模块的计算设备,其被配置为接收包含自然用户输入的输入数据并识别输入数据中的自然用户输入。 计算设备还可以包括耦合到算法预处理模块的手势模块,所述手势模块被配置为将自然用户输入与手势库中的手势相关联。 计算设备还可以包括映射模块以将手势映射到传统控制器输入,并且响应于自然用户输入将遗留控制器输入发送到传统系统。

    HOLOGRAPHIC OBJECT FEEDBACK
    28.
    发明申请
    HOLOGRAPHIC OBJECT FEEDBACK 有权
    全息对象反馈

    公开(公告)号:US20140306891A1

    公开(公告)日:2014-10-16

    申请号:US13862210

    申请日:2013-04-12

    IPC分类号: G06F3/01

    摘要: Methods for providing real-time feedback to an end user of a mobile device as they are interacting with or manipulating one or more virtual objects within an augmented reality environment are described. The real-time feedback may comprise visual feedback, audio feedback, and/or haptic feedback. In some embodiments, a mobile device, such as a head-mounted display device (HMD), may determine an object classification associated with a virtual object within an augmented reality environment, detect an object manipulation gesture performed by an end user of the mobile device, detect an interaction with the virtual object based on the object manipulation gesture, determine a magnitude of a virtual force associated with the interaction, and provide real-time feedback to the end user of the mobile device based on the interaction, the magnitude of the virtual force applied to the virtual object, and the object classification associated with the virtual object.

    摘要翻译: 描述了在移动设备与增强现实环境中交互或操纵一个或多个虚拟对象时向终端用户提供实时反馈的方法。 实时反馈可以包括视觉反馈,音频反馈和/或触觉反馈。 在一些实施例中,诸如头戴式显示设备(HMD)的移动设备可以确定与增强现实环境中的虚拟对象相关联的对象分类,检测移动设备的最终用户执行的对象操纵手势 基于对象操纵手势来检测与虚拟对象的交互,确定与交互相关联的虚拟力的大小,并且基于相互作用向移动设备的最终用户提供实时反馈,其大小 应用于虚拟对象的虚拟力以及与虚拟对象相关联的对象分类。

    AUGMENTED REALITY HELP
    29.
    发明申请
    AUGMENTED REALITY HELP 有权
    赞助的现实帮助

    公开(公告)号:US20140139551A1

    公开(公告)日:2014-05-22

    申请号:US13683732

    申请日:2012-11-21

    IPC分类号: G09G5/377

    摘要: A system and related methods for an augmented reality help system in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. An augmented reality help program is configured to receive one or more user biometric parameters from the plurality of sensors. Based on the user biometric parameters, the program determines that the user is experiencing a stress response, and presents help content to the user via the head-mounted display device.

    摘要翻译: 提供了一种用于头戴式显示装置中的增强现实帮助系统的系统和相关方法。 在一个示例中,头戴式显示装置包括多个传感器和用于呈现全息物体的显示系统。 增强现实帮助程序被配置为从多个传感器接收一个或多个用户生物特征参数。 基于用户生物特征参数,程序确定用户正在经历压力响应,并通过头戴式显示设备向用户呈现帮助内容。

    Augmented reality help
    30.
    发明授权
    Augmented reality help 有权
    增强现实帮助

    公开(公告)号:US09030495B2

    公开(公告)日:2015-05-12

    申请号:US13683732

    申请日:2012-11-21

    摘要: A system and related methods for an augmented reality help system in a head-mounted display device are provided. In one example, the head-mounted display device includes a plurality of sensors and a display system for presenting holographic objects. An augmented reality help program is configured to receive one or more user biometric parameters from the plurality of sensors. Based on the user biometric parameters, the program determines that the user is experiencing a stress response, and presents help content to the user via the head-mounted display device.

    摘要翻译: 提供了一种用于头戴式显示装置中的增强现实帮助系统的系统和相关方法。 在一个示例中,头戴式显示装置包括多个传感器和用于呈现全息物体的显示系统。 增强现实帮助程序被配置为从多个传感器接收一个或多个用户生物特征参数。 基于用户生物特征参数,程序确定用户正在经历压力响应,并通过头戴式显示设备向用户呈现帮助内容。