公开(公告)号：US20230232008A1

公开(公告)日：2023-07-20

申请号：US17576250

申请日：2022-01-14

Applicant: META PLATFORMS TECHNOLOGIES LLC

Inventor： Brian Funt ,  Behnam Bastani ,  Curtis Buckoll

IPC: H04N19/132 ,  H04N19/172 ,  G06T9/00 ,  H04N19/85 ,  H04N19/136 ,  H04N19/182 ,  H04N19/42

CPC classification number: H04N19/132 ,  H04N19/172 ,  G06T9/00 ,  H04N19/85 ,  H04N19/136 ,  H04N19/182 ,  H04N19/42

Abstract: In one embodiment, the disclosure provides a computer-implemented method for Progressive Subsampled Transmission of image data. In one embodiment, a source computer may: generate a first down-sampled frame by sampling an input image according to a first sampling pattern; generate a first encoded down-sampled frame; transmit the first encoded down-sampled frame to a recipient device to cause the recipient device to display/use a first output frame generated by decoding and up-sampling the first encoded down-sampled frame; generate a second down-sampled frame by sampling the input image according to a second sampling pattern; generate a second encoded down-sampled frame; and transmit the second encoded down-sampled frame to the recipient device to cause the recipient device to display/use a second output frame generated based on the first encoded down-sampled frame and the second encoded down-sampled frame and in accordance with the first sampling pattern and the second sampling pattern.

公开(公告)号：US11838513B2

公开(公告)日：2023-12-05

申请号：US17576250

申请日：2022-01-14

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Brian Funt ,  Behnam Bastani ,  Curtis Buckoll

IPC: H04N19/132 ,  H04N19/172 ,  H04N19/42 ,  H04N19/136 ,  G06T9/00 ,  H04N19/182 ,  H04N19/85

CPC classification number: H04N19/132 ,  G06T9/00 ,  H04N19/136 ,  H04N19/172 ,  H04N19/182 ,  H04N19/42 ,  H04N19/85

Abstract: In one embodiment, the disclosure provides a computer-implemented method for Progressive Subsampled Transmission of image data. In one embodiment, a source computer may: generate a first down-sampled frame by sampling an input image according to a first sampling pattern; generate a first encoded down-sampled frame; transmit the first encoded down-sampled frame to a recipient device to cause the recipient device to display/use a first output frame generated by decoding and up-sampling the first encoded down-sampled frame; generate a second down-sampled frame by sampling the input image according to a second sampling pattern; generate a second encoded down-sampled frame; and transmit the second encoded down-sampled frame to the recipient device to cause the recipient device to display/use a second output frame generated based on the first encoded down-sampled frame and the second encoded down-sampled frame and in accordance with the first sampling pattern and the second sampling pattern.

公开(公告)号：US11721064B1

公开(公告)日：2023-08-08

申请号：US17220771

申请日：2021-04-01

Applicant: Meta Platforms Technologies, LLC

Inventor： Volga Aksoy ,  Reza Nourai ,  Brian Funt ,  Haomiao Jiang ,  Curtis Buckoll

IPC: G06T15/80 ,  G06T15/20 ,  H04L67/10 ,  G06N20/00 ,  G06T15/04

CPC classification number: G06T15/80 ,  G06N20/00 ,  G06T15/04 ,  G06T15/20 ,  H04L67/10

Abstract: In one embodiment, a method includes a server generating first shading information for visible portions of objects relative to a first viewpoint, storing the first shading information in a texture atlas, and sending the texture atlas to a client device. The method also includes determining a first subset of the visible portions of the objects for which shading information is to be re-generated and a second subset for which elements of the first shading information are to be reused, generating second shading information for the first subset relative to a second viewpoint, updating the texture atlas to include the second shading information for the first subset and the elements of the first shading information for the second subset, and sending the updated texture atlas to the client device. The updated texture atlas is configured for rendering images of the visible portions of the objects from multiple viewpoints.

公开(公告)号：US11544894B2

公开(公告)日：2023-01-03

申请号：US17187624

申请日：2021-02-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Brian Funt ,  Reza Nourai ,  Volga Aksoy ,  Zeyar Htet

IPC: G06T15/20 ,  G06N3/08 ,  G06N3/04

Abstract: A method includes the steps of receiving training data comprising images of an object and associated camera poses from which the images are captured, training, based on the training data, a machine-learning model to take as input a given viewpoint and synthesize an image of a virtual representation of the object viewed from the given viewpoint, generating, for each of predetermined viewpoints surrounding the virtual representation of the object, a view-dependent image of the object as viewed from that viewpoint using the trained machine-learning model, receiving, from a client device, a desired viewpoint from which to view the virtual representation of the object, selecting one or more of the predetermined viewpoints based on the desired viewpoint, and sending, to the client device, the view-dependent images associated with the selected one or more viewpoints for rendering an output image of the virtual representation of the object viewed from the desired viewpoint.