Augmenting multi-view image data with synthetic objects using IMU and image data

    公开(公告)号:US10152825B2

    公开(公告)日:2018-12-11

    申请号:US15009807

    申请日:2016-01-28

    Applicant: Fyusion, Inc.

    Abstract: Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (IMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera's intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.

    AUTOMATIC TAGGING OF OBJECTS ON A MULTI-VIEW INTERACTIVE DIGITAL MEDIA REPRESENTATION OF A DYNAMIC ENTITY

    公开(公告)号:US20170277363A1

    公开(公告)日:2017-09-28

    申请号:US15620506

    申请日:2017-06-12

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present disclosure relate generally to systems and methods for automatic tagging of objects on a multi-view interactive digital media representation of a dynamic entity. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a multi-view interactive digital media representation for presentation on a device. Multi-view interactive digital media representations correspond to multi-view interactive digital media representations of the dynamic objects in backgrounds. A first multi-view interactive digital media representation of a dynamic object is obtained. Next, the dynamic object is tagged. Then, a second multi-view interactive digital media representation of the dynamic object is generated. Finally, the dynamic object in the second multi-view interactive digital media representation is automatically identified and tagged.

    AUGMENTING MULTI-VIEW IMAGE DATA WITH SYNTHETIC OBJECTS USING IMU AND IMAGE DATA

    公开(公告)号:US20170109930A1

    公开(公告)日:2017-04-20

    申请号:US15009807

    申请日:2016-01-28

    Applicant: Fyusion, Inc.

    CPC classification number: G06T19/006 G06T13/20 G06T2219/028

    Abstract: Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (IMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera's intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.

Patent Agency Ranking