公开(公告)号：US11676324B2

公开(公告)日：2023-06-13

申请号：US17217261

申请日：2021-03-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Reza Nourai ,  Volga Aksoy ,  Zeyar Htet

IPC: G06T15/04 ,  G06T1/60 ,  G06T9/00 ,  G06T15/20 ,  H04L67/10

CPC classification number: G06T15/04 ,  G06T1/60 ,  G06T9/00 ,  G06T15/20 ,  H04L67/10

Abstract: In one embodiment, a method includes the steps of receiving, from a client device, a first viewpoint from which to view a virtual object, the virtual object having a shape defined by multiple geometric primitives, identifying, relative to the first viewpoint, visible geometric primitives from multiple geometric primitives, allocating a region in a texture atlas for each of the visible geometric primitives, generating shading information for each of the visible geometric primitives, storing the shading information of each of the visible geometric primitives in a portion of the allocated region smaller than the allocated region to create a buffer around the portion of the allocated region where the shading information is stored, and sending, to the client device, the texture atlas and a list identifying the visible geometric primitives, the texture atlas being configured for rendering images of the visible geometric primitives from different viewpoints.

公开(公告)号：US20240249440A1

公开(公告)日：2024-07-25

申请号：US18417962

申请日：2024-01-19

Applicant: Meta Platforms Technologies, LLC

Inventor： Zeyar Htet ,  Volga Aksoy ,  Binyamin Abramov

IPC: G06T9/00

CPC classification number: G06T9/001

Abstract: Particular embodiments described herein present a technique for compressing a 3D mesh. A computing system may access a topology-coding list and a vertex list representing a 3D mesh. The vertex list may comprise X, Y, and Z coordinates for ordered vertices in the 3D mesh. The computing system may construct a predicted vertex list based on the vertex list. The computing system may generate X, Y, and Z coordinate bit streams. Each coordinate bit stream may comprise ordered coordinate values for a corresponding coordinate in the predicted vertex list. Each coordinate value in a coordinate bit stream may be represented in a corresponding number of bits. The corresponding number of bits may be stored in a memory-size list corresponding to the coordinate bit stream. The computing system may encode the topology-coding list and memory-size lists corresponding to the X, Y, and Z coordinate bit streams using Zstandard coder.

公开(公告)号：US20230245375A1

公开(公告)日：2023-08-03

申请号：US18295749

申请日：2023-04-04

Applicant: Meta Platforms Technologies, LLC

Inventor： Reza Nourai ,  Volga Aksoy ,  Zeyar Htet

IPC: G06T15/04 ,  G06T1/60 ,  G06T9/00 ,  G06T15/20

CPC classification number: G06T15/04 ,  G06T1/60 ,  G06T9/00 ,  G06T15/20 ,  H04L67/10

Abstract: In one embodiment, a method includes a step of receiving a geometric representation of a virtual object and a texture atlas, the geometric representation comprising multiple geometric primitives defining a shape of the virtual object, the texture atlas comprises regions each of which is allocated to include shading information of a respective geometric primitive of the plurality of geometric primitives, and the shading information of the respective geometric primitive being scaled down to be smaller than the allocated region so as to create a buffer between the allocated region and adjacent regions of the plurality of regions on the texture atlas. The method further includes steps of identifying, based on a first viewpoint from which to view the virtual object, visible geometric primitives from the plurality of geometric primitives and rendering images of the visible geometric primitives using corresponding shading information included in the texture atlas.

公开(公告)号：US20240296590A1

公开(公告)日：2024-09-05

申请号：US18534271

申请日：2023-12-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Volga Aksoy ,  Zeyar Htet ,  Reza Nourai

IPC: G06T9/00 ,  G06T15/04 ,  G06T15/20 ,  G06T17/20

CPC classification number: G06T9/001 ,  G06T15/04 ,  G06T15/20 ,  G06T17/205

Abstract: In one embodiment, a method includes receiving a first viewpoint associated with a head-mounted device from the head-mounted device, accessing a 3D mesh of a virtual scene, selecting a portion of the 3D mesh based on the first viewpoint, generating an image and a corresponding depth map of the virtual scene based on the selected portion of the 3D mesh, generating a simplified 3D mesh based on the depth map, wherein the simplified 3D mesh has fewer primitives than the selected portion of 3D mesh of the virtual scene, generating a texture for the simplified 3D mesh based on the image, and sending the simplified 3D mesh and the texture to the head-mount device, wherein the simplified 3D mesh and the texture are configured to be used for rendering the virtual scene from one or more viewpoints different from the first viewpoint.

公开(公告)号：US11721064B1

公开(公告)日：2023-08-08

申请号：US17220771

申请日：2021-04-01

Applicant: Meta Platforms Technologies, LLC

Inventor： Volga Aksoy ,  Reza Nourai ,  Brian Funt ,  Haomiao Jiang ,  Curtis Buckoll

IPC: G06T15/80 ,  G06T15/20 ,  H04L67/10 ,  G06N20/00 ,  G06T15/04

CPC classification number: G06T15/80 ,  G06N20/00 ,  G06T15/04 ,  G06T15/20 ,  H04L67/10

Abstract: In one embodiment, a method includes a server generating first shading information for visible portions of objects relative to a first viewpoint, storing the first shading information in a texture atlas, and sending the texture atlas to a client device. The method also includes determining a first subset of the visible portions of the objects for which shading information is to be re-generated and a second subset for which elements of the first shading information are to be reused, generating second shading information for the first subset relative to a second viewpoint, updating the texture atlas to include the second shading information for the first subset and the elements of the first shading information for the second subset, and sending the updated texture atlas to the client device. The updated texture atlas is configured for rendering images of the visible portions of the objects from multiple viewpoints.

公开(公告)号：US11544894B2

公开(公告)日：2023-01-03

申请号：US17187624

申请日：2021-02-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Brian Funt ,  Reza Nourai ,  Volga Aksoy ,  Zeyar Htet

IPC: G06T15/20 ,  G06N3/08 ,  G06N3/04

Abstract: A method includes the steps of receiving training data comprising images of an object and associated camera poses from which the images are captured, training, based on the training data, a machine-learning model to take as input a given viewpoint and synthesize an image of a virtual representation of the object viewed from the given viewpoint, generating, for each of predetermined viewpoints surrounding the virtual representation of the object, a view-dependent image of the object as viewed from that viewpoint using the trained machine-learning model, receiving, from a client device, a desired viewpoint from which to view the virtual representation of the object, selecting one or more of the predetermined viewpoints based on the desired viewpoint, and sending, to the client device, the view-dependent images associated with the selected one or more viewpoints for rendering an output image of the virtual representation of the object viewed from the desired viewpoint.