3-DIMENSIONAL SCENE ANALYSIS FOR AUGMENTED REALITY OPERATIONS

    公开(公告)号:US20170243352A1

    公开(公告)日:2017-08-24

    申请号:US15046614

    申请日:2016-02-18

    Abstract: Techniques are provided for 3D analysis of a scene including detection, segmentation and registration of objects within the scene. The analysis results may be used to implement augmented reality operations including removal and insertion of objects and the generation of blueprints. An example method may include receiving 3D image frames of the scene, each frame associated with a pose of a depth camera, and creating a 3D reconstruction of the scene based on depth pixels that are projected and accumulated into a global coordinate system. The method may also include detecting objects, and associated locations within the scene, based on the 3D reconstruction, the camera pose and the image frames. The method may further include segmenting the detected objects into points of the 3D reconstruction corresponding to contours of the object and registering the segmented objects to 3D models of the objects to determine their alignment.

    GENERATION OF SYNTHETIC 3-DIMENSIONAL OBJECT IMAGES FOR RECOGNITION SYSTEMS

    公开(公告)号:US20210056768A1

    公开(公告)日:2021-02-25

    申请号:US17012881

    申请日:2020-09-04

    Abstract: Techniques are provided for generation of synthetic 3-dimensional object image variations for training of recognition systems. An example system may include an image synthesizing circuit configured to synthesize a 3D image of the object (including color and depth image pairs) based on a 3D model. The system may also include a background scene generator circuit configured to generate a background for each of the rendered image variations. The system may further include an image pose adjustment circuit configured to adjust the orientation and translation of the object for each of the variations. The system may further include an illumination and visual effect adjustment circuit configured to adjust illumination of the object and the background for each of the variations, and to further adjust visual effects of the object and the background for each of the variations based on application of simulated camera parameters.

    3-dimensional scene analysis for augmented reality operations

    公开(公告)号:US10373380B2

    公开(公告)日:2019-08-06

    申请号:US15046614

    申请日:2016-02-18

    Abstract: Techniques are provided for 3D analysis of a scene including detection, segmentation and registration of objects within the scene. The analysis results may be used to implement augmented reality operations including removal and insertion of objects and the generation of blueprints. An example method may include receiving 3D image frames of the scene, each frame associated with a pose of a depth camera, and creating a 3D reconstruction of the scene based on depth pixels that are projected and accumulated into a global coordinate system. The method may also include detecting objects, and associated locations within the scene, based on the 3D reconstruction, the camera pose and the image frames. The method may further include segmenting the detected objects into points of the 3D reconstruction corresponding to contours of the object and registering the segmented objects to 3D models of the objects to determine their alignment.

    Generation of synthetic 3-dimensional object images for recognition systems

    公开(公告)号:US10068385B2

    公开(公告)日:2018-09-04

    申请号:US14969563

    申请日:2015-12-15

    Abstract: Techniques are provided for generation of synthetic 3-dimensional object image variations for training of recognition systems. An example system may include an image synthesizing circuit configured to synthesize a 3D image of the object (including color and depth image pairs) based on a 3D model. The system may also include a background scene generator circuit configured to generate a background for each of the rendered image variations. The system may further include an image pose adjustment circuit configured to adjust the orientation and translation of the object for each of the variations. The system may further include an illumination and visual effect adjustment circuit configured to adjust illumination of the object and the background for each of the variations, and to further adjust visual effects of the object and the background for each of the variations based on application of simulated camera parameters.

    Systems and techniques for user interface control
    19.
    发明授权
    Systems and techniques for user interface control 有权
    用于用户界面控制的系统和技术

    公开(公告)号:US09395821B2

    公开(公告)日:2016-07-19

    申请号:US14405731

    申请日:2014-03-27

    CPC classification number: G06F3/017 G06F3/011 G06F3/0304 G06K9/00355 G06T7/70

    Abstract: Embodiments of systems and techniques for user interface (UI) control are disclosed herein. In some embodiments, a UI control system may determine locations of landmarks on a body of a user of a computing system, determine a pointer based at least in part on the landmark locations, and identify a UI element of an UI of the computing system based at least in part on the pointer. Other embodiments may be described and/or claimed.

    Abstract translation: 本文公开了用于用户界面(UI)控制的系统和技术的实施例。 在一些实施例中,UI控制系统可以确定计算系统的用户身体上的地标的位置,至少部分地基于地标位置确定指针,并且基于计算系统的UI识别UI元素 至少部分地指针。 可以描述和/或要求保护其他实施例。

    INTERACTION OF MULTIPLE PERCEPTUAL SENSING INPUTS
    20.
    发明申请
    INTERACTION OF MULTIPLE PERCEPTUAL SENSING INPUTS 审中-公开
    多项感知输入的相互作用

    公开(公告)号:US20140258942A1

    公开(公告)日:2014-09-11

    申请号:US13785669

    申请日:2013-03-05

    Abstract: A system and method for using multiple perceptual sensing technologies to capture information about a user's actions and for synergistically processing the information is described. Non-limiting examples of perceptual sensing technologies include gesture recognition using depth sensors, two-dimensional cameras, gaze detection, and/or speech recognition. The information captured about a user's gestures using one type of sensing technology is often not able to be captured with another type of technology. Thus, using multiple perceptual sensing technologies allows more information to be captured about the user's gestures. Further, by synergistically leveraging the information acquired using multiple perceptual sensing technologies, a more natural user interface can be created for a user to interact with an electronic device.

    Abstract translation: 描述了使用多种感知感知技术捕获关于用户动作的信息并协同处理信息的系统和方法。 感知感知技术的非限制性实例包括使用深度传感器,二维摄像机,凝视检测和/或语音识别的手势识别。 使用一种感测技术拍摄的关于用户手势的信息通常不能用另一种类型的技术来捕获。 因此,使用多种感知感知技术可以获得关于用户手势的更多信息。 此外,通过协同地利用使用多种感知感知技术获得的信息,可以创建更自然的用户界面以供用户与电子设备交互。

Patent Agency Ranking