公开(公告)号：US20230298269A1

公开(公告)日：2023-09-21

申请号：US18014307

申请日：2020-08-31

Applicant: Google LLC

Inventor： Kyle Adam Genova ,  Daniel Vlasic ,  Forrester H. Cole

IPC: G06T17/20 ,  G06T7/90

CPC classification number: G06T17/20 ,  G06T7/90

Abstract: Systems and methods of the present disclosure are directed to a method that can include obtaining a 3D mesh comprising polygons and texture/shading data. The method can include rasterizing the 3D mesh to obtain a 2D raster comprising pixels and coordinates respectively associated with a subset of pixels. The method can include determining an initial color value for the subset of pixels based on the coordinates of the pixel and the associated shading/texture data. The method can include constructing a splat at the coordinates of a respective pixel. The method can include determining an updated color value for a respective pixel based on a weighting of the subset of splats to generate a 2D rendering of the 3D mesh based on the coordinates of a pixel and a splat.

公开(公告)号：US20240119697A1

公开(公告)日：2024-04-11

申请号：US18012264

申请日：2022-10-10

Applicant: Google LLC

Inventor： Daniel Christopher Duckworth ,  Suhani Deepak-Ranu Vora ,  Noha Radwan ,  Klaus Greff ,  Henning Meyer ,  Kyle Adam Genova ,  Seyed Mohammad Mehdi Sajjadi ,  Etienne François Régis Pot ,  Andrea Tagliasacchi

IPC: G06V10/26 ,  G06T7/143 ,  G06T15/08

CPC classification number: G06V10/26 ,  G06T7/143 ,  G06T15/08 ,  G06T2207/20076 ,  G06T2207/20081

Abstract: Example embodiments of the present disclosure provide an example computer-implemented method for constructing a three-dimensional semantic segmentation of a scene from two-dimensional inputs. The example method includes obtaining, by a computing system comprising one or more processors, an image set comprising one or more views of a subject scene. The example method includes generating, by the computing system and based at least in part on the image set, a scene representation describing the subject scene in three dimensions. The example method includes generating, by the computing system and using a machine-learned semantic segmentation model framework, a multidimensional field of probability distributions over semantic categories, the multidimensional field defined over the three dimensions of the subject scene. The example method includes outputting, by the computing system, classification data for at least one location in the subject scene.

公开(公告)号：US12288295B2

公开(公告)日：2025-04-29

申请号：US18014307

申请日：2020-08-31

Applicant: Google LLC

Inventor： Kyle Adam Genova ,  Daniel Vlasic ,  Forrester H. Cole

IPC: G06T17/20 ,  G06T7/90

Abstract: Systems and methods of the present disclosure are directed to a method that can include obtaining a 3D mesh comprising polygons and texture/shading data. The method can include rasterizing the 3D mesh to obtain a 2D raster comprising pixels and coordinates respectively associated with a subset of pixels. The method can include determining an initial color value for the subset of pixels based on the coordinates of the pixel and the associated shading/texture data. The method can include constructing a splat at the coordinates of a respective pixel. The method can include determining an updated color value for a respective pixel based on a weighting of the subset of splats to generate a 2D rendering of the 3D mesh based on the coordinates of a pixel and a splat.