Artificially rendering images using viewpoint interpolation and extrapolation

    公开(公告)号:US10147211B2

    公开(公告)日:2018-12-04

    申请号:US14800642

    申请日:2015-07-15

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present invention relate generally to systems and methods for artificially rendering images using viewpoint interpolation and extrapolation. According to particular embodiments, a method includes moving a set of control points perpendicular to a trajectory between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. The set of control points is associated with a layer and each control point is moved based on an associated depth of the control point. The method also includes generating an artificially rendered image corresponding to a third location outside of the trajectory by extrapolating individual control points using the set of control points for the third location and extrapolating pixel locations using the individual control points.

    VIRTUAL REALITY ENVIRONMENT BASED MANIPULATION OF MULTI-LAYERED MULTI-VIEW INTERACTIVE DIGITAL MEDIA REPRESENTATIONS

    公开(公告)号:US20180046357A1

    公开(公告)日:2018-02-15

    申请号:US15724087

    申请日:2017-10-03

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present disclosure relate generally to systems and methods for generating multi-view interactive digital media representations in a virtual reality environment. According to particular embodiments, a plurality of images is fused into a first content model and a first context model, both of which include multi-view interactive digital media representations of objects. Next, a virtual reality environment is generated using the first content model and the first context model. The virtual reality environment includes a first layer and a second layer. The user can navigate through and within the virtual reality environment to switch between multiple viewpoints of the content model via corresponding physical movements. The first layer includes the first content model and the second layer includes a second content model and wherein selection of the first layer provides access to the second layer with the second content model.

    ARTIFICIALLY RENDERING IMAGES USING VIEWPOINT INTERPOLATION AND EXTRAPOLATION

    公开(公告)号:US20170084001A1

    公开(公告)日:2017-03-23

    申请号:US14860983

    申请日:2015-09-22

    Applicant: Fyusion, Inc.

    CPC classification number: G06T11/60 G06T5/005 H04N13/111

    Abstract: Various embodiments of the present invention relate generally to systems and methods for artificially rendering images using viewpoint interpolation and/or extrapolation. According to particular embodiments, a transformation between a first frame and a second frame is estimated, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. An artificially rendered image corresponding to a third location positioned on a trajectory between the first location and the second location is then generated by interpolating a transformation from the first location to the third location and from the third location to the second location and gathering image information from the first frame and the second frame by transferring first image information from the first frame to the third frame based on the interpolated transformation and second image information from the second frame to the third frame based on the interpolated transformation. The first image information and the second image information are then combined. If an occlusion is created by a change in layer placement between the first frame and second frame, this occlusion is detected and missing data is replaced to fill the occlusion.

    ANALYSIS AND MANIPULATION OF PANORAMIC SURROUND VIEWS
    78.
    发明申请
    ANALYSIS AND MANIPULATION OF PANORAMIC SURROUND VIEWS 有权
    全景观景观分析与处理

    公开(公告)号:US20150130894A1

    公开(公告)日:2015-05-14

    申请号:US14539889

    申请日:2014-11-12

    Applicant: Fyusion, Inc.

    Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. According to particular embodiments, the spatial relationship between multiple images and video is analyzed together with location information data, for purposes of creating a representation referred to herein as a surround view. In particular embodiments, a surround view can be generated by combining a panoramic view of an object with a panoramic view of a distant scene, such that the object panorama is placed in a foreground position relative to the distant scene panorama. Such combined panoramas can enhance the interactive and immersive viewing experience of the surround view.

    Abstract translation: 本发明的各种实施例一般涉及用于分析和操纵图像和视频的系统和方法。 根据特定实施例,为了创建本文中称为环绕视图的表示的目的,分析多个图像和视频之间的空间关系以及位置信息数据。 在特定实施例中,环绕视图可以通过将物体的全景视图与远景场景的全景相结合来产生,使得物体全景相对于遥远的场景全景被放置在前景位置。 这种组合的全景可以增强环绕视图的交互式和沉浸式观看体验。

    Artificially rendering images using viewpoint interpolation and extrapolation

    公开(公告)号:US12020355B2

    公开(公告)日:2024-06-25

    申请号:US17519452

    申请日:2021-11-04

    Applicant: Fyusion, Inc.

    CPC classification number: G06T11/60 G06T15/205 H04N13/111

    Abstract: Various embodiments of the present invention relate generally to systems and methods for artificially rendering images using viewpoint interpolation and extrapolation. According to particular embodiments, a method includes moving a set of control points perpendicular to a trajectory between a first frame and a second frame, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. The set of control points is associated with a layer and each control point is moved based on an associated depth of the control point. The method also includes generating an artificially rendered image corresponding to a third location outside of the trajectory by extrapolating individual control points using the set of control points for the third location and extrapolating pixel locations using the individual control points.

Patent Agency Ranking