AUTOMATIC TAGGING OF OBJECTS ON A MULTI-VIEW INTERACTIVE DIGITAL MEDIA REPRESENTATION OF A DYNAMIC ENTITY

    公开(公告)号:US20190278434A1

    公开(公告)日:2019-09-12

    申请号:US16426323

    申请日:2019-05-30

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present disclosure relate generally to systems and methods for automatic tagging of objects on a multi-view interactive digital media representation of a dynamic entity. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a multi-view interactive digital media representation for presentation on a device. Multi-view interactive digital media representations correspond to multi-view interactive digital media representations of the dynamic objects in backgrounds. A first multi-view interactive digital media representation of a dynamic object is obtained. Next, the dynamic object is tagged. Then, a second multi-view interactive digital media representation of the dynamic object is generated. Finally, the dynamic object in the second multi-view interactive digital media representation is automatically identified and tagged.

    ARTIFICIALLY RENDERING IMAGES USING VIEWPOINT INTERPOLATION AND EXTRAPOLATION

    公开(公告)号:US20190080499A1

    公开(公告)日:2019-03-14

    申请号:US16179746

    申请日:2018-11-02

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present invention relate generally to systems and methods for artificially rendering images using viewpoint interpolation and extrapolation. According to particular embodiments, a method includes moving a set of control points perpendicular to a trajectory between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. The set of control points is associated with a layer and each control point is moved based on an associated depth of the control point. The method also includes generating an artificially rendered image corresponding to a third location outside of the trajectory by extrapolating individual control points using the set of control points for the third location and extrapolating pixel locations using the individual control points.

    AUGMENTING MULTI-VIEW IMAGE DATA WITH SYNTHETIC OBJECTS USING IMU AND IMAGE DATA

    公开(公告)号:US20190073834A1

    公开(公告)日:2019-03-07

    申请号:US16181227

    申请日:2018-11-05

    Applicant: Fyusion Inc.

    Abstract: Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (IMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera's intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.

    ARTIFICIALLY RENDERING IMAGES USING VIEWPOINT INTERPOLATION AND EXTRAPOLATION
    39.
    发明申请
    ARTIFICIALLY RENDERING IMAGES USING VIEWPOINT INTERPOLATION AND EXTRAPOLATION 审中-公开
    使用视点插值和扩展进行人工渲染图像

    公开(公告)号:US20170018054A1

    公开(公告)日:2017-01-19

    申请号:US14800640

    申请日:2015-07-15

    Applicant: Fyusion, Inc.

    CPC classification number: G06T11/60 G06K9/00664 G06T15/205 G06T2210/44

    Abstract: Various embodiments of the present invention relate generally to mechanisms and processes relating to artificially rendering images using viewpoint interpolation and extrapolation. According to particular embodiments, a method includes applying a transform to estimate a path outside the trajectory between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. The process also includes generating an artificially rendered image corresponding to a third location positioned on the path. The artificially rendered image is generated by interpolating a transformation from the first location to the third location and from the third location to the second location, gathering image information from the first frame and the second frame by transferring first image information from the first frame to the third frame and second image information from the second frame to the third frame, and combining the first image information and the second image information.

    Abstract translation: 本发明的各种实施例总体上涉及使用视点内插和外推来人工渲染图像的机制和过程。 根据特定实施例,一种方法包括应用变换来估计在第一帧和第二帧之间的轨迹之外的路径,其中第一帧包括从第一位置捕获的第一图像,并且第二帧包括从 第二个位置。 该过程还包括生成对应于位于路径上的第三位置的人为渲染图像。 通过内插来自第一位置到第三位置以及从第三位置到第二位置的变换来生成人为渲染图像,通过将第一图像信息从第一帧传送到第二帧来收集来自第一帧和第二帧的图像信息 第三帧和第二图像信息从第二帧到第三帧,并且组合第一图像信息和第二图像信息。

Patent Agency Ranking