Methods and systems for performing 3D simulation based on a 2D video image

    公开(公告)号:US11217006B2

    公开(公告)日:2022-01-04

    申请号:US16666338

    申请日:2019-10-28

    Abstract: An exemplary three-dimensional (3D) simulation system accesses a two-dimensional (2D) video image captured by a video capture device and that depicts a bounded real-world scene and a real-world object present within the bounded real-world scene. The 3D simulation system accesses respective 3D models of the bounded real-world scene and the real-world object. Based on the 2D video image, the 3D simulation system tracks a spatial characteristic of the real-world object relative to the bounded real-world scene. Based on the tracked spatial characteristic of the real-world object and the 3D models of the bounded real-world scene and the real-world object, the 3D simulation system generates a 3D simulation of the bounded real-world scene within which the real-world object is simulated in accordance with the tracked spatial characteristic of the real-world object. Corresponding methods and systems are also disclosed.

    Methods and systems for generating an animated 3D model based on a 2D image

    公开(公告)号:US11145133B2

    公开(公告)日:2021-10-12

    申请号:US16831209

    申请日:2020-03-26

    Abstract: An illustrative volumetric capture system accesses a two-dimensional (“2D”) image captured by a capture device and depicting a first subject of a particular subject type. The volumetric capture system generates a custom three-dimensional (“3D”) model of the first subject by identifying a parameter representative of a characteristic of the first subject, applying the parameter to a parametric 3D model to generate a custom mesh, and applying a custom texture based on the 2D image to the custom mesh. The volumetric capture system also accesses a motion capture video depicting motion performed by a second subject of the particular subject type. Based on the motion capture video, the volumetric capture system animates the custom 3D model of the first subject to cause the custom 3D model to perform the motion performed by the second subject. Corresponding methods and systems are also disclosed.

    Methods and Systems for Generating an Animated 3D Model Based on a 2D Image

    公开(公告)号:US20200312037A1

    公开(公告)日:2020-10-01

    申请号:US16831209

    申请日:2020-03-26

    Abstract: An illustrative volumetric capture system accesses a two-dimensional (“2D”) image captured by a capture device and depicting a first subject of a particular subject type. The volumetric capture system generates a custom three-dimensional (“3D”) model of the first subject by identifying a parameter representative of a characteristic of the first subject, applying the parameter to a parametric 3D model to generate a custom mesh, and applying a custom texture based on the 2D image to the custom mesh. The volumetric capture system also accesses a motion capture video depicting motion performed by a second subject of the particular subject type. Based on the motion capture video, the volumetric capture system animates the custom 3D model of the first subject to cause the custom 3D model to perform the motion performed by the second subject. Corresponding methods and systems are also disclosed.

    Probabilistic model to compress images for three-dimensional video

    公开(公告)号:US11025959B2

    公开(公告)日:2021-06-01

    申请号:US16559613

    申请日:2019-09-03

    Abstract: A method includes receiving head-tracking data that describe one or more positions of people while the people are viewing a three-dimensional video. The method further includes generating a probabilistic model of the one or more positions of the people based on the head-tracking data, wherein the probabilistic model identifies a probability of a viewer looking in a particular direction as a function of time. The method further includes generating video segments from the three-dimensional video. The method further includes, for each of the video segments: determining a directional encoding format that projects latitudes and longitudes of locations of a surface of a sphere onto locations on a plane, determining a cost function that identifies a region of interest on the plane based on the probabilistic model, and generating optimal segment parameters that minimize a sum-over position for the region of interest.

Patent Agency Ranking