Augmented reality with direct user interaction
    4.
    发明授权
    Augmented reality with direct user interaction 有权
    增强现实与直接用户互动

    公开(公告)号:US09529424B2

    公开(公告)日:2016-12-27

    申请号:US12940322

    申请日:2010-11-05

    摘要: Augmented reality with direct user interaction is described. In one example, an augmented reality system comprises a user-interaction region, a camera that captures images of an object in the user-interaction region, and a partially transparent display device which combines a virtual environment with a view of the user-interaction region, so that both are visible at the same time to a user. A processor receives the images, tracks the object's movement, calculates a corresponding movement within the virtual environment, and updates the virtual environment based on the corresponding movement. In another example, a method of direct interaction in an augmented reality system comprises generating a virtual representation of the object having the corresponding movement, and updating the virtual environment so that the virtual representation interacts with virtual objects in the virtual environment. From the user's perspective, the object directly interacts with the virtual objects.

    摘要翻译: 描述了与直接用户交互的增强现实。 在一个示例中,增强现实系统包括用户交互区域,捕获用户交互区域中的对象的图像的相机以及将虚拟环境与用户交互区域的视图组合的部分透明显示设备 ,这样两者都可以同时显示给用户。 处理器接收图像,跟踪对象的移动,计算虚拟环境中的相应移动,并且基于相应的移动来更新虚拟环境。 在另一示例中,增强现实系统中的直接交互的方法包括生成具有相应移动的对象的虚拟表示,并且更新虚拟环境,使得虚拟表示与虚拟环境中的虚拟对象交互。 从用户的角度来看,对象直接与虚拟对象进行交互。

    Reducing Interference Between Multiple Infra-Red Depth Cameras
    6.
    发明申请
    Reducing Interference Between Multiple Infra-Red Depth Cameras 有权
    减少多个红外深度相机之间的干扰

    公开(公告)号:US20120194650A1

    公开(公告)日:2012-08-02

    申请号:US13017518

    申请日:2011-01-31

    IPC分类号: H04N13/02

    摘要: Systems and methods for reducing interference between multiple infra-red depth cameras are described. In an embodiment, the system comprises multiple infra-red sources, each of which projects a structured light pattern into the environment. A controller is used to control the sources in order to reduce the interference caused by overlapping light patterns. Various methods are described including: cycling between the different sources, where the cycle used may be fixed or may change dynamically based on the scene detected using the cameras; setting the wavelength of each source so that overlapping patterns are at different wavelengths; moving source-camera pairs in independent motion patterns; and adjusting the shape of the projected light patterns to minimize overlap. These methods may also be combined in any way. In another embodiment, the system comprises a single source and a mirror system is used to cast the projected structured light pattern around the environment.

    摘要翻译: 描述了用于减少多个红外深度摄像机之间的干扰的系统和方法。 在一个实施例中,系统包括多个红外源,每个红外源将结构化的光图案投射到环境中。 控制器用于控制源,以减少由重叠的光图案引起的干扰。 描述了各种方法,包括:在不同的源之间循环,其中使用的周期可以是固定的,或者可以基于使用相机检测的场景动态地改变; 设置每个源的波长,使得重叠图案处于不同的波长; 以独立运动模式移动源摄像机对; 并调整投影光图案的形状以最小化重叠。 这些方法也可以以任何方式组合。 在另一个实施例中,系统包括单个源,并且使用镜子系统将投射的结构化光图案围绕环境投射。

    Moving object segmentation using depth images
    7.
    发明授权
    Moving object segmentation using depth images 有权
    使用深度图像移动物体分割

    公开(公告)号:US08401225B2

    公开(公告)日:2013-03-19

    申请号:US13017626

    申请日:2011-01-31

    IPC分类号: G06K9/00

    摘要: Moving object segmentation using depth images is described. In an example, a moving object is segmented from the background of a depth image of a scene received from a mobile depth camera. A previous depth image of the scene is retrieved, and compared to the current depth image using an iterative closest point algorithm. The iterative closest point algorithm includes a determination of a set of points that correspond between the current depth image and the previous depth image. During the determination of the set of points, one or more outlying points are detected that do not correspond between the two depth images, and the image elements at these outlying points are labeled as belonging to the moving object. In examples, the iterative closest point algorithm is executed as part of an algorithm for tracking the mobile depth camera, and hence the segmentation does not add substantial additional computational complexity.

    摘要翻译: 描述使用深度图像来移动物体分割。 在一个示例中,从从移动深度相机接收的场景的深度图像的背景中分割移动物体。 检索场景的先前深度图像,并使用迭代最近点算法与当前深度图像进行比较。 迭代最近点算法包括对当前深度图像和先前深度图像之间对应的一组点的确定。 在确定点集合期间,检测到一个或多个在两个深度图像之间不对应的离开点,并且将这些离散点处的图像元素标记为属于移动对象。 在示例中,迭代最近点算法作为用于跟踪移动深度相机的算法的一部分被执行,因此分割不会增加实质的额外的计算复杂度。

    Reducing interference between multiple infra-red depth cameras
    8.
    发明授权
    Reducing interference between multiple infra-red depth cameras 有权
    降低多个红外深度摄像机之间的干扰

    公开(公告)号:US09247238B2

    公开(公告)日:2016-01-26

    申请号:US13017518

    申请日:2011-01-31

    IPC分类号: H04N13/02 H04N5/33

    摘要: Systems and methods for reducing interference between multiple infra-red depth cameras are described. In an embodiment, the system comprises multiple infra-red sources, each of which projects a structured light pattern into the environment. A controller is used to control the sources in order to reduce the interference caused by overlapping light patterns. Various methods are described including: cycling between the different sources, where the cycle used may be fixed or may change dynamically based on the scene detected using the cameras; setting the wavelength of each source so that overlapping patterns are at different wavelengths; moving source-camera pairs in independent motion patterns; and adjusting the shape of the projected light patterns to minimize overlap. These methods may also be combined in any way. In another embodiment, the system comprises a single source and a mirror system is used to cast the projected structured light pattern around the environment.

    摘要翻译: 描述了用于减少多个红外深度摄像机之间的干扰的系统和方法。 在一个实施例中,系统包括多个红外源,每个红外源将结构化的光图案投射到环境中。 控制器用于控制源,以减少由重叠的光图案引起的干扰。 描述了各种方法,包括:在不同的源之间循环,其中使用的周期可以是固定的,或者可以基于使用相机检测的场景动态地改变; 设置每个源的波长,使得重叠图案处于不同的波长; 以独立运动模式移动源摄像机对; 并调整投影光图案的形状以最小化重叠。 这些方法也可以以任何方式组合。 在另一个实施例中,系统包括单个源,并且使用镜子系统将投射的结构化光图案围绕环境投射。