Recognition-based object segmentation of a 3-dimensional image

    公开(公告)号:US10482681B2

    公开(公告)日:2019-11-19

    申请号:US15019011

    申请日:2016-02-09

    Abstract: Techniques are provided for segmentation of objects in a 3D image of a scene. An example method may include receiving, 3D image frames of a scene. Each of the frames is associated with a pose of a depth camera that generated the 3D image frames. The method may also include detecting the objects in each of the frames based on object recognition; associating a label with the detected object; calculating a 2D bounding box around the object; and calculating a 3D location of the center of the bounding box. The method may further include matching the detected object to an existing object boundary set, created from a previously received image frame, based on the label and the location of the center of the bounding box, or, if the match fails, creating a new object boundary set associated with the detected object.

    3-DIMENSIONAL SCENE ANALYSIS FOR AUGMENTED REALITY OPERATIONS

    公开(公告)号:US20170243352A1

    公开(公告)日:2017-08-24

    申请号:US15046614

    申请日:2016-02-18

    Abstract: Techniques are provided for 3D analysis of a scene including detection, segmentation and registration of objects within the scene. The analysis results may be used to implement augmented reality operations including removal and insertion of objects and the generation of blueprints. An example method may include receiving 3D image frames of the scene, each frame associated with a pose of a depth camera, and creating a 3D reconstruction of the scene based on depth pixels that are projected and accumulated into a global coordinate system. The method may also include detecting objects, and associated locations within the scene, based on the 3D reconstruction, the camera pose and the image frames. The method may further include segmenting the detected objects into points of the 3D reconstruction corresponding to contours of the object and registering the segmented objects to 3D models of the objects to determine their alignment.

    MODEL-BASED MULTI-HYPOTHESIS TARGET TRACKER
    5.
    发明申请
    MODEL-BASED MULTI-HYPOTHESIS TARGET TRACKER 有权
    基于模型的多重目标跟踪器

    公开(公告)号:US20140232631A1

    公开(公告)日:2014-08-21

    申请号:US13768835

    申请日:2013-02-15

    Abstract: The present disclosure describes a target tracker that evaluates frames of data of one or more targets, such as a body part, body, and/or object, acquired by a depth camera. Positions of the joints of the target(s) in the previous frame and the data from a current frame are used to determine the positions of the joints of the target(s) in the current frame. To perform this task, the tracker proposes several hypotheses and then evaluates the data to validate the respective hypotheses. The hypothesis that best fits the data generated by the depth camera is selected, and the joints of the target(s) are mapped accordingly.

    Abstract translation: 本公开描述了评估由深度相机获取的一个或多个目标(诸如身体部位,身体和/或物体)的数据帧的目标跟踪器。 使用前一帧中的目标的关节的位置和来自当前帧的数据来确定当前帧中的目标的关节的位置。 为了执行这个任务,跟踪器提出几个假设,然后评估数据以验证相应的假设。 选择最适合深度摄像机生成的数据的假设,并且相应地映射目标的关节。

    SYSTEM AND METHOD FOR USER INTERACTION AND CONTROL OF ELECTRONIC DEVICES
    6.
    发明申请
    SYSTEM AND METHOD FOR USER INTERACTION AND CONTROL OF ELECTRONIC DEVICES 审中-公开
    用于电子设备的用户交互和控制的系统和方法

    公开(公告)号:US20140123077A1

    公开(公告)日:2014-05-01

    申请号:US13676017

    申请日:2012-11-13

    CPC classification number: G06F3/017 G06F3/0304 G06F3/04842

    Abstract: A system and method for close range object tracking are described. Close range depth images of a user's hands and fingers are acquired using a depth sensor. Movements of the user's hands and fingers are identified and tracked. This information is used to permit the user to interact with a virtual object, such as an icon or other object displayed on a screen, or the screen itself.

    Abstract translation: 描述了用于近距离对象跟踪的系统和方法。 使用深度传感器获取用户手和手指的近距离深度图像。 识别和跟踪用户手指的移动。 该信息用于允许用户与虚拟对象(诸如屏幕上显示的图标或其他对象)或屏幕本身进行交互。

    SYSTEM AND METHOD FOR COMBINING DATA FROM MULTIPLE DEPTH CAMERAS
    7.
    发明申请
    SYSTEM AND METHOD FOR COMBINING DATA FROM MULTIPLE DEPTH CAMERAS 审中-公开
    用于从多个深度摄像机组合数据的系统和方法

    公开(公告)号:US20140104394A1

    公开(公告)日:2014-04-17

    申请号:US13652181

    申请日:2012-10-15

    Abstract: A system and method for combining depth images taken from multiple depth cameras into a composite image are described. The volume of space captured in the composite image is configurable in size and shape depending upon the number of depth cameras used and the shape of the cameras' imaging sensors. Tracking of movements of a person or object can be performed on the composite image. The tracked movements can subsequently be used by an interactive application.

    Abstract translation: 描述将从多个深度相机拍摄的深度图像组合成合成图像的系统和方法。 根据所使用的深度相机的数量和相机的成像传感器的形状,在合成图像中捕获的空间体积可根据尺寸和形状进行配置。 可以对合成图像执行人或物体的移动跟踪。 跟踪的动作随后可以由交互式应用程序使用。

    3-dimensional scene analysis for augmented reality operations

    公开(公告)号:US10373380B2

    公开(公告)日:2019-08-06

    申请号:US15046614

    申请日:2016-02-18

    Abstract: Techniques are provided for 3D analysis of a scene including detection, segmentation and registration of objects within the scene. The analysis results may be used to implement augmented reality operations including removal and insertion of objects and the generation of blueprints. An example method may include receiving 3D image frames of the scene, each frame associated with a pose of a depth camera, and creating a 3D reconstruction of the scene based on depth pixels that are projected and accumulated into a global coordinate system. The method may also include detecting objects, and associated locations within the scene, based on the 3D reconstruction, the camera pose and the image frames. The method may further include segmenting the detected objects into points of the 3D reconstruction corresponding to contours of the object and registering the segmented objects to 3D models of the objects to determine their alignment.

Patent Agency Ranking