Augmented reality camera registration
    1.
    发明授权
    Augmented reality camera registration 有权
    增强现实相机注册

    公开(公告)号:US09524436B2

    公开(公告)日:2016-12-20

    申请号:US13312869

    申请日:2011-12-06

    IPC分类号: G09G5/00 G06K9/00 G06T7/00

    摘要: A system and method executable by a computing device of an augmented reality system for registering a camera in a physical space is provided. The method may include identifying an origin marker in a series of images of a physical space captured by a camera of an augmented reality system, and defining a marker graph having an origin marker node. The method may further include analyzing in real-time the series of images to identify a plurality of expansion markers with locations defined relative to previously imaged markers, and defining corresponding expansion marker nodes in the marker graph. The method may further include calculating a current position of the camera of the augmented reality system in the physical space based on a location of a node in the marker graph corresponding to a most recently imaged marker, relative to the origin marker and any intermediate markers.

    摘要翻译: 提供了一种可通过用于在物理空间中登记相机的增强现实系统的计算装置执行的系统和方法。 该方法可以包括识别由增强现实系统的相机捕获的物理空间的一系列图像中的原始标记,并且定义具有原点标记节点的标记图。 该方法还可以包括实时分析一系列图像以识别具有相对于先前成像的标记定义的位置的多个扩展标记,以及在标记图中定义对应的扩展标记节点。 该方法还可以包括基于相对于原始标记和任何中间标记对应于最近成像的标记的标记图中的节点的位置来计算物理空间中的增强现实系统的相机的当前位置。

    Mesh generation from depth images
    2.
    发明授权
    Mesh generation from depth images 有权
    网格生成从深度图像

    公开(公告)号:US08976168B2

    公开(公告)日:2015-03-10

    申请号:US13287486

    申请日:2011-11-02

    摘要: Systems and methods for mesh generation from depth images are provided. According to one aspect, a method executable by a compression device for sending compressed depth information is provided. The method may comprise, at a compression module executed on the compression device, receiving a depth image of a scene from a depth camera. The depth image may include a matrix of pixels, each pixel in the matrix including a depth value indicating a depth of an object in the scene observed at that pixel. The method may further comprise compressing the depth image into a tree data structure, and sending the tree data structure via a communication path to a rendering device for generating a mesh of the scene at the rendering device.

    摘要翻译: 提供了从深度图像生成网格的系统和方法。 根据一个方面,提供了一种由压缩装置执行的用于发送压缩深度信息的方法。 该方法可以包括在压缩装置上执行的压缩模块,从深度相机接收场景的深度图像。 深度图像可以包括像素矩阵,矩阵中的每个像素包括指示在该像素处观察到的场景中的物体的深度的深度值。 该方法还可以包括将深度图像压缩成树状数据结构,以及经由通信路径将树状数据结构发送到呈现设备,用于在渲染设备处生成场景的网格。

    MESH GENERATION FROM DEPTH IMAGES
    3.
    发明申请
    MESH GENERATION FROM DEPTH IMAGES 有权
    从深度图像中产生的MESH

    公开(公告)号:US20130106852A1

    公开(公告)日:2013-05-02

    申请号:US13287486

    申请日:2011-11-02

    IPC分类号: G06T17/20

    摘要: Systems and methods for mesh generation from depth images are provided. According to one aspect, a method executable by a compression device for sending compressed depth information is provided. The method may comprise, at a compression module executed on the compression device, receiving a depth image of a scene from a depth camera. The depth image may include a matrix of pixels, each pixel in the matrix including a depth value indicating a depth of an object in the scene observed at that pixel. The method may further comprise compressing the depth image into a tree data structure, and sending the tree data structure via a communication path to a rendering device for generating a mesh of the scene at the rendering device.

    摘要翻译: 提供了从深度图像生成网格的系统和方法。 根据一个方面,提供了一种由压缩装置执行的用于发送压缩深度信息的方法。 该方法可以包括在压缩装置上执行的压缩模块,从深度相机接收场景的深度图像。 深度图像可以包括像素矩阵,矩阵中的每个像素包括指示在该像素处观察到的场景中的物体的深度的深度值。 该方法还可以包括将深度图像压缩成树状数据结构,以及经由通信路径将树状数据结构发送到呈现设备,用于在渲染设备处生成场景的网格。

    AUGMENTED REALITY CAMERA REGISTRATION
    4.
    发明申请
    AUGMENTED REALITY CAMERA REGISTRATION 有权
    已实现的摄像机注册

    公开(公告)号:US20130141461A1

    公开(公告)日:2013-06-06

    申请号:US13312869

    申请日:2011-12-06

    IPC分类号: G09G5/00

    摘要: A system and method executable by a computing device of an augmented reality system for registering a camera in a physical space is provided. The method may include identifying an origin marker in a series of images of a physical space captured by a camera of an augmented reality system, and defining a marker graph having an origin marker node. The method may further include analyzing in real-time the series of images to identify a plurality of expansion markers with locations defined relative to previously imaged markers, and defining corresponding expansion marker nodes in the marker graph. The method may further include calculating a current position of the camera of the augmented reality system in the physical space based on a location of a node in the marker graph corresponding to a most recently imaged marker, relative to the origin marker and any intermediate markers.

    摘要翻译: 提供了一种可通过用于在物理空间中登记相机的增强现实系统的计算装置执行的系统和方法。 该方法可以包括识别由增强现实系统的相机捕获的物理空间的一系列图像中的原始标记,并且定义具有原点标记节点的标记图。 该方法还可以包括实时分析一系列图像以识别具有相对于先前成像的标记定义的位置的多个扩展标记,以及在标记图中定义对应的扩展标记节点。 该方法还可以包括基于相对于原始标记和任何中间标记对应于最近成像的标记的标记图中的节点的位置来计算物理空间中的增强现实系统的相机的当前位置。

    USE OF SURFACE RECONSTRUCTION DATA TO IDENTIFY REAL WORLD FLOOR
    5.
    发明申请
    USE OF SURFACE RECONSTRUCTION DATA TO IDENTIFY REAL WORLD FLOOR 有权
    使用表面重建数据识别实际世界地板

    公开(公告)号:US20160027217A1

    公开(公告)日:2016-01-28

    申请号:US14697227

    申请日:2015-04-27

    摘要: In a virtual reality or mixed reality environment, an HMD device is configured to use surface reconstruction data points obtained with a sensor package to identify a location of a floor of a real world environment in which the device operates by sorting the data points by height into respective buckets where each bucket holds a different range of heights. A bucket having the greatest number of data points that are below the height of a user of the HMD device is used to identify the height of the real world floor, for example, by calculating an average of height values of data points in that bucket. A floor for the virtual reality environment may then be aligned to the identified height of the real world floor.

    摘要翻译: 在虚拟现实或混合现实环境中,HMD设备被配置为使用由传感器包获得的表面重建数据点,以通过将数据点按高度排序来识别设备操作的现实世界环境的楼层的位置 相应的桶,其中每个桶具有不同的高度范围。 使用具有低于HMD设备的用户的高度的数据点数量最多的桶,例如通过计算该桶中的数据点的高度值的平均值来识别真实世界楼层的高度。 虚拟现实环境的地板然后可以与现实世界楼层的识别高度对齐。

    VIRTUAL REALITY ENVIRONMENT WITH REAL WORLD OBJECTS
    6.
    发明申请
    VIRTUAL REALITY ENVIRONMENT WITH REAL WORLD OBJECTS 有权
    虚拟现实环境与真正的世界对象

    公开(公告)号:US20160027215A1

    公开(公告)日:2016-01-28

    申请号:US14688695

    申请日:2015-04-16

    IPC分类号: G06T19/00 G02B27/01 G06T19/20

    摘要: An HMD device renders a virtual reality environment in which areas of the real world are masked out so that real world objects such as computer monitors, doors, people, faces, and the like appear visible to the device user and no holographic or virtual reality content is rendered over the visible objects. The HMD device includes a sensor package to support application of surface reconstruction techniques to dynamically detect edges and surfaces of the real world objects and keep objects visible on the display as the user changes position or head pose or when the real world objects move or their positions are changed. The HMD device can expose controls to enable the user to select which real world objects are visible in the virtual reality environment.

    摘要翻译: HMD设备呈现虚拟现实环境,其中真实世界的哪些区域被屏蔽,使得诸如计算机显示器,门,人物,面部等的真实世界对象对于设备用户看起来是可见的,并且没有全息或虚拟现实内容 呈现在可见对象上。 HMD设备包括传感器封装,以支持表面重建技术的应用,以动态地检测真实世界对象的边缘和表面,并且当用户改变位置或头部姿势或当现实世界对象移动或其位置时,使对象在显示器上可见 改变了 HMD设备可以暴露控件以使用户能够选择哪些真实世界对象在虚拟现实环境中是可见的。

    MOUSE SHARING BETWEEN A DESKTOP AND A VIRTUAL WORLD
    7.
    发明申请
    MOUSE SHARING BETWEEN A DESKTOP AND A VIRTUAL WORLD 审中-公开
    桌面和虚拟世界之间的鼠标共享

    公开(公告)号:US20160027214A1

    公开(公告)日:2016-01-28

    申请号:US14628539

    申请日:2015-02-23

    摘要: A mixed-reality head mounted display (HMD) device supports a three dimensional (3D) virtual world application with which a real world desktop displayed on a monitor coupled to a personal computer (PC) may interact and share mouse input. A mouse input server executing on the PC tracks mouse movements on the desktop displayed on a monitor. When movement of the mouse takes it beyond the edge of the monitor screen, the mouse input server takes control of the mouse and stops mouse messages from propagating through the PC's system. The mouse input server communicates over a network connection to a mouse input client exposed by the application to inform the client that the mouse has transitioned to operating in the virtual world and passes mouse messages describing movements and control operation such as button presses.

    摘要翻译: 混合现实头戴式显示器(HMD)装置支持三维(3D)虚拟世界应用程序,与耦合到个人计算机(PC)的显示器上显示的真实世界桌面可以交互并共享鼠标输入。 在PC上执行的鼠标输入服务器跟踪显示在显示器上的桌面上的鼠标移动。 当鼠标移动超出监视器屏幕的边缘时,鼠标输入服务器控制鼠标并停止鼠标消息传播通过PC的系统。 鼠标输入服务器通过网络连接与由应用程序公开的鼠标输入客户端进行通信,通知客户鼠标已经转换为在虚拟世界中操作,并传递描述运动的鼠标消息和控制操作(如按钮按压)。

    SMART PLACEMENT OF VIRTUAL OBJECTS TO STAY IN THE FIELD OF VIEW OF A HEAD MOUNTED DISPLAY
    8.
    发明申请
    SMART PLACEMENT OF VIRTUAL OBJECTS TO STAY IN THE FIELD OF VIEW OF A HEAD MOUNTED DISPLAY 有权
    虚拟对象的智能放置在头戴式显示器的视野中

    公开(公告)号:US20160025981A1

    公开(公告)日:2016-01-28

    申请号:US14612850

    申请日:2015-02-03

    IPC分类号: G02B27/01 G06F3/01 G02B27/00

    摘要: An HMD device is configured to check the placement of newly introduced objects in a virtual reality environment such as interactive elements like menus, widgets, and notifications to confirm that the objects are significantly present within the user's field of view. If the intended original placement would locate the object outside the field of view, the HMD device relocates the object so that a portion of the object is viewable at the edge of the HMD display closest to its original placement. Such smart placement of virtual objects enables the user to readily discover new objects when they are introduced into the virtual reality environment, and then interact with the objects within a range of motions and/or head positions that is comfortable to support a more optimal interaction and user experience.

    摘要翻译: HMD设备被配置为检查新引入的对象在虚拟现实环境中的放置,诸如诸如菜单,小部件和通知之类的交互元素,以确认对象在用户视野内显着存在。 如果预期的原始位置将物体定位在视野外,则HMD装置重新定位物体,使得物体的一部分在最接近其原始位置的HMD显示器的边缘处可见。 虚拟对象的这种智能放置使得用户能够在被引入到虚拟现实环境中时容易地发现新对象,然后在运动和/或头部位置的范围内与对象交互以支持更优化的交互和 用户体验。

    GAZE-BASED OBJECT PLACEMENT WITHIN A VIRTUAL REALITY ENVIRONMENT
    9.
    发明申请
    GAZE-BASED OBJECT PLACEMENT WITHIN A VIRTUAL REALITY ENVIRONMENT 审中-公开
    在虚拟现实环境中基于GAZE的对象放置

    公开(公告)号:US20160026242A1

    公开(公告)日:2016-01-28

    申请号:US14697109

    申请日:2015-04-27

    摘要: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a device user's projected gaze with a location in a virtual reality environment so that virtual objects can be placed into the environment with high precision. Surface reconstruction of the physical environment can be applied using data from the sensor package to determine the user's view position in the virtual world. A gaze ray originating from the view position is projected outward and a cursor or similar indicator is rendered on the HMD display at the ray's closest intersection with the virtual world such as a virtual object, floor/ground, etc. In response to user input, such as a gesture, voice interaction, or control manipulation, a virtual object is placed at the point of intersection between the projected gaze ray and the virtual reality environment.

    摘要翻译: 在现实世界物理环境中操作的头戴显示器(HMD)设备配置有传感器封装,其能够确定设备用户的投射凝视与虚拟现实环境中的位置的交集,使得虚拟对象可以被放置在 环境精度高。 可以使用来自传感器包的数据来应用物理环境的表面重建,以确定用户在虚拟世界中的视图位置。 来自观察位置的注视射线向外突出,并且在与虚拟世界(例如虚拟物体,地面/地面等)的射线最近的交叉点处在HMD显示器上呈现光标或类似的指示符。响应于用户输入, 例如手势,语音交互或控制操作,虚拟对象被放置在投影的注视射线与虚拟现实环境之间的交点处。

    MULTI-USER GAZE PROJECTION USING HEAD MOUNTED DISPLAY DEVICES
    10.
    发明申请
    MULTI-USER GAZE PROJECTION USING HEAD MOUNTED DISPLAY DEVICES 审中-公开
    使用头安装显示设备的多用户大小投影

    公开(公告)号:US20160027218A1

    公开(公告)日:2016-01-28

    申请号:US14723065

    申请日:2015-05-27

    摘要: A head mounted display (HMD) device operating in a real world physical environment is configured with a sensor package that enables determination of an intersection of a projection of the device user's gaze with a location in a mixed or virtual reality environment. When a projected gaze ray is visibly rendered on other HMD devices (where all the devices are operatively coupled), users of those devices can see what the user is looking at in the environment. In multi-user settings, each HMD device user can see each other's projected gaze rays which can facilitate collaboration in a commonly-shared and experienced mixed or virtual reality environment. The gaze projection can be used much like a finger to point at an object, or to indicate a location on a surface with precision and accuracy.

    摘要翻译: 在现实世界物理环境中操作的头戴式显示器(HMD)设备配置有传感器封装,其能够确定设备用户的注视的投影与混合或虚拟现实环境中的位置的交集。 当在其他HMD设备(其中所有设备可操作地耦合)上可见地呈现投影的注视射线时,这些设备的用户可以看到用户在环境中看到什么。 在多用户设置中,每个HMD设备用户可以看到彼此的投射凝视射线,这可以促进共享和经验的混合或虚拟现实环境中的协作。 注视投影可以非常像手指来指向物体,或者以精确和准确的方式指示表面上的位置。