-
公开(公告)号:US12192651B2
公开(公告)日:2025-01-07
申请号:US18463477
申请日:2023-09-08
Applicant: GOOGLE LLC
Inventor: Ryan Overbeck
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.
-
公开(公告)号:US20220030184A1
公开(公告)日:2022-01-27
申请号:US17450625
申请日:2021-10-12
Applicant: GOOGLE LLC
Inventor: Ryan Overbeck
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.
-
公开(公告)号:US20210368157A1
公开(公告)日:2021-11-25
申请号:US17325818
申请日:2021-05-20
Applicant: Google LLC
Inventor: Ryan Overbeck , Michael Joseph Broxton , John Flynn , Daniel William Erickson , Lars Peter Johannes Hedman , Matthew Nowicki DuVall , Jason Angelo Dourgarian , Jessica Lynn Busch , Matthew Stephen Whalen , Paul Debevec
IPC: H04N13/282 , H04N5/232 , H04N19/177 , H04N13/15 , H04N13/271 , H04N13/194 , H04N13/172 , H04N5/247 , H04N13/161
Abstract: Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.
-
公开(公告)号:US11758295B2
公开(公告)日:2023-09-12
申请号:US17450625
申请日:2021-10-12
Applicant: GOOGLE LLC
Inventor: Ryan Overbeck
CPC classification number: H04N25/41 , G06T15/06 , G06T15/08 , G06T15/205
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.
-
公开(公告)号:US11172148B2
公开(公告)日:2021-11-09
申请号:US16736469
申请日:2020-01-07
Applicant: Google LLC
Inventor: Ryan Overbeck
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image (MPI) that represents a three-dimensional image; splitting the MPI into a plurality of sub-volumes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image (MDI) to be rendered; calculating, for each layer of the plurality of layers, an image that indicates a color and a transmittance of each voxel included in the layer; storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI; and, in response to receiving a request for the three-dimensional image from a user device, transmitting the MDI to the user device, wherein the user device is configured to render the MDI by mapping, for each layer of the MDI, the image corresponding to the layer as a texture on the mesh corresponding to the layer.
-
公开(公告)号:US20210211593A1
公开(公告)日:2021-07-08
申请号:US16736469
申请日:2020-01-07
Applicant: Google LLC
Inventor: Ryan Overbeck
IPC: H04N5/341 , H04N13/282 , H04N5/347
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image (MPI) that represents a three-dimensional image; splitting the MPI into a plurality of sub-volumes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image (MDI) to be rendered; calculating, for each layer of the plurality of layers, an image that indicates a color and a transmittance of each voxel included in the layer; storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI; and, in response to receiving a request for the three-dimensional image from a user device, transmitting the MDI to the user device, wherein the user device is configured to render the MDI by mapping, for each layer of the MDI, the image corresponding to the layer as a texture on the mesh corresponding to the layer.
-
公开(公告)号:US20240073551A1
公开(公告)日:2024-02-29
申请号:US18463477
申请日:2023-09-08
Applicant: GOOGLE LLC
Inventor: Ryan Overbeck
CPC classification number: H04N25/41 , G06T15/06 , G06T15/08 , G06T15/205
Abstract: Methods, systems, and media for generating compressed images are provided. In some embodiments, the method comprises: identifying a multi-plane image, MPI, that represents a three-dimensional image, wherein the MPI comprises a plurality of fronto-parallel planes; splitting the MPI into a plurality of sub-volumes, wherein each sub-volume in the plurality of sub-volumes includes a subset of the plurality of fronto-parallel planes; calculating, for each sub-volume of the MPI, a depthmap; converting each depthmap to a mesh, wherein each mesh corresponds to a layer of a plurality of layers associated with a multi-depth image, MDI, to be rendered; calculating, for each layer of the plurality of layers, an image; and storing the meshes corresponding to the plurality of layers of the MDI and the images corresponding to the plurality of layers of the MDI as the MDI.
-
8.
公开(公告)号:US20230206511A1
公开(公告)日:2023-06-29
申请号:US18117675
申请日:2023-03-06
Applicant: Google LLC
Inventor: Ryan Overbeck , Michael Joseph Broxton , John Flynn , Daniel William Erickson , Lars Peter Johannes Hedman , Matthew Nowicki DuVall , Jason Angelo Dourgarian , Jessica Lynn Busch , Matthew Stephen Whalen , Paul Debevec
CPC classification number: G06T9/001 , G06T17/20 , G06T15/04 , G06T7/50 , G06T2207/20021 , G06T2207/10024
Abstract: Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.
-
公开(公告)号:US11601636B2
公开(公告)日:2023-03-07
申请号:US17325818
申请日:2021-05-20
Applicant: Google LLC
Inventor: Ryan Overbeck , Michael Joseph Broxton , John Flynn , Daniel William Erickson , Lars Peter Johannes Hedman , Matthew Nowicki DuVall , Jason Angelo Dourgarian , Jessica Lynn Busch , Matthew Stephen Whalen , Paul Debevec
IPC: G06T15/08 , H04N13/282 , H04N5/232 , H04N19/177 , H04N13/15 , H04N13/161 , H04N13/194 , H04N13/172 , H04N5/247 , H04N13/271 , G06T15/20
Abstract: Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.
-
公开(公告)号:US10460505B2
公开(公告)日:2019-10-29
申请号:US15395278
申请日:2016-12-30
Applicant: GOOGLE LLC
Inventor: Ryan Overbeck
Abstract: A method for rendering a view from a lightfield includes identifying a ray associated with a portion of the view and selecting a set of camera views from a plurality of camera views representing the lightfield based on an intersection point of the ray with a plane. Each camera view has an associated contribution region disposed on the plane. The associated contribution region overlaps contribution regions associated with other camera views of the set of camera views at the intersection point. The method also includes determining a characteristic of the ray based on a contribution factor for each camera view of the set of camera views. The contribution factor is determined based on the relative position of the intersection point within the associated contribution region.
-
-
-
-
-
-
-
-
-