公开(公告)号：US20240273764A1

公开(公告)日：2024-08-15

申请号：US18168111

申请日：2023-02-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang ,  Xuejing Lei

IPC: G06T9/00 ,  G06T7/11 ,  G06T7/40 ,  G06T7/90

CPC classification number: G06T9/00 ,  G06T7/11 ,  G06T7/40 ,  G06T7/90 ,  G06T2207/10024 ,  G06T2207/20021

Abstract: In one embodiment, a computer system may access one or more first texture components and one or more second texture components of a physically-based rendering (PBR) texture set. The computer system may further determine a predicted texture component associated with each of the one or more second texture components based on the one or more first texture components. The computing system may further determine, for each of the one or more second texture components, a residual component, based on a comparison of the predicted texture component and each of the one or more second texture components. The computing system may then encode the PBR texture set based on the one or more first texture components and the residual components.

公开(公告)号：US11748914B2

公开(公告)日：2023-09-05

申请号：US17003560

申请日：2020-08-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang ,  Zhi Zhou ,  Richard Webb ,  Richard Lawrence Greene

IPC: G06T9/00 ,  G06T7/70 ,  H04L5/00 ,  H04L65/70 ,  H04L65/75 ,  H04N19/124 ,  H04N19/14 ,  H04N19/15 ,  H04N19/186 ,  G06T7/90

CPC classification number: G06T9/00 ,  G06T7/90 ,  H04L5/0046 ,  H04L65/70 ,  H04L65/75

Abstract: In one embodiment, a computing system may access color components of a pixel region in an image, and then determine a color variance for each of the color components. The computing system may further determine a desired bit allocation for each of the color components based on the color variance associated with that color component. The computing system may then determine a total bit allocation for the pixel region based on the desired bit allocations for the color components, as well as a number of unallocated bits available for allocation. The computing system may further determine a final bit allocation for each of the color components by allocating the total bit allocation to each of the color components according to the desired bit allocation for each of the color components. The computing system may then encode each of the color components using the associated final bit allocation.

公开(公告)号：US20230224369A1

公开(公告)日：2023-07-13

申请号：US17572439

申请日：2022-01-10

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Zhiqing Rao ,  Eugene Gorbatov ,  Chris Rojas ,  Dong Zheng ,  Cheng Chang ,  Yuting Fan

IPC: H04L67/131 ,  H04W24/08 ,  G06T19/00

CPC classification number: H04L67/38 ,  H04W24/08 ,  G06T19/006

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

公开(公告)号：US20230120593A1

公开(公告)日：2023-04-20

申请号：US17971077

申请日：2022-10-21

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang ,  Richard Lawrence Greene ,  Richard Webb

IPC: G06T9/00

Abstract: Disclosed herein includes a system, a method, and a device for compressing image data. The device includes one or more processors, coupled to memory, configured to identify a plurality of sub-blocks of a block of image data including a first sub-block and a second sub-block. The one or more processors are configured to identify a first data characteristic of data of the first sub-block and a second data characteristic of data of the second sub-block, determine a first compression technique based at least on the first data characteristic of the first sub-block, determine a second compression technique based at least on the second data characteristic of the second sub-block, and compress the first sub-block using the first compression technique and the second sub-block using the second compression technique.

公开(公告)号：US11734858B2

公开(公告)日：2023-08-22

申请号：US17671023

申请日：2022-02-14

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Cheng Chang ,  Richard Webb ,  Richard Lawrence Greene

IPC: G06T11/00 ,  G06T9/00 ,  G06T15/00 ,  G06T19/00 ,  H04N1/60 ,  H04N19/00 ,  H04N19/12 ,  H04N19/17 ,  G09G5/00 ,  G06K9/46 ,  G06T7/90

CPC classification number: G06T9/00 ,  G06T7/90

Abstract: In an embodiment, a method involves accessing a first pixel block of an image, the first pixel block comprising pixels, each associated with multiple pixel components, determining whether to separately or jointly encode the multiple pixel components of each of the pixels of the first pixel block, determining that the multiple pixel components of each of the pixels in the first pixel block are to be jointly encoded based on (1) determining, based on the multiple pixel components of each of the pixels, a line defined within a three-dimensional coordinate system in which each of the pixels is represented as a three-dimensional point and (2) determining that the line satisfies a predetermined criteria, and encoding the multiple pixel components of each of the pixels in the first pixel block as a single quantized value based on a projection of the three-dimensional point associated with that pixel onto the line.

公开(公告)号：US11481929B2

公开(公告)日：2022-10-25

申请号：US16820264

申请日：2020-03-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang ,  Richard Lawrence Greene ,  Richard Webb

IPC: G06T9/00

Abstract: Disclosed herein includes a system, a method, and a device for compressing image data. The device includes one or more processors, coupled to memory, configured to identify a plurality of sub-blocks of a block of image data including a first sub-block and a second sub-block. The one or more processors are configured to identify a first data characteristic of data of the first sub-block and a second data characteristic of data of the second sub-block, determine a first compression technique based at least on the first data characteristic of the first sub-block, determine a second compression technique based at least on the second data characteristic of the second sub-block, and compress the first sub-block using the first compression technique and the second sub-block using the second compression technique.

公开(公告)号：US20240273806A1

公开(公告)日：2024-08-15

申请号：US18168120

申请日：2023-02-13

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang

IPC: G06T15/04 ,  G06T7/40 ,  G06T9/00

CPC classification number: G06T15/04 ,  G06T7/40 ,  G06T9/00 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A computing system may receive training texture components; encode each of the training texture components at multiple training bitrates; render multiple reconstructed images associated with multiple total training bitrates for encoding the training components based on combinations of decoded training texture components at the multiple training bitrates; determine a desired reconstructed image for each of the multiple total training bitrates for encoding the training components; extract a desired training bit allocation across the training texture components associated with the desired reconstructed image for each of the multiple total training bitrates for encoding the training texture components; and train a machine-learning model to learn a bit allocation for encoding each of texture components using the training texture components, the multiple total training bitrates for encoding the training components, and the desired training bit allocation across the training texture components.

公开(公告)号：US11917011B2

公开(公告)日：2024-02-27

申请号：US17572439

申请日：2022-01-10

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Zhiqing Rao ,  Eugene Gorbatov ,  Chris Rojas ,  Dong Zheng ,  Cheng Chang ,  Yuting Fan

IPC: G06T19/00 ,  H04L67/131 ,  H04W24/08

CPC classification number: H04L67/131 ,  G06T19/006 ,  H04W24/08

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the first subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.

公开(公告)号：US20230215054A1

公开(公告)日：2023-07-06

申请号：US18182029

申请日：2023-03-10

Applicant: Meta Platforms Technologies, LLC

Inventor： Cheng Chang ,  Zhi Zhou ,  Richard Webb ,  Richard Lawrence Greene

IPC: G06T9/00 ,  H04N19/115 ,  H04N19/146 ,  H04N19/157 ,  H04N19/184 ,  G06T1/60

CPC classification number: G06T9/00 ,  H04N19/115 ,  H04N19/146 ,  H04N19/157 ,  H04N19/184 ,  G06T1/60

Abstract: A computing system may access first alpha values associated with first pixels in a first pixel region of an image and determine a bit budget for encoding the first alpha values. The computing system may then select a first alpha-encoding mode for the first alpha values to reflect a determination that the first alpha values are all fully transparent or all fully opaque, and encode the first alpha values by storing the selected first alpha-encoding mode as part of a metadata without using the bit budget to encode the first alpha values individually. The computing system may then update a record of unallocated bits available for allocation based on the bit budget unused in the encoding of the first alpha values, and allocate, based on the record of unallocated bits, bits to encode a set of alpha values different from the first alpha values.

公开(公告)号：US20240205294A1

公开(公告)日：2024-06-20

申请号：US18589305

申请日：2024-02-27

Applicant: Meta Platforms Technologies, LLC

Inventor： Zhiqing Rao ,  Eugene Gorbatov ,  Dong Zheng ,  Cheng Chang ,  Yuting Fan ,  Chris Rojas

IPC: H04L67/131 ,  G06T19/00 ,  H04W24/08

CPC classification number: H04L67/131 ,  G06T19/006 ,  H04W24/08

Abstract: A method by a rendering device includes receiving a request to render multiple surfaces corresponding to multiple virtual objects to be concurrently displayed on an augmented-reality (AR) headset. The method further includes that the AR headset is connected to the rendering device via a wireless link. In response to a determination that a network quality of the wireless link is below a threshold condition, the method further includes selecting a first subset of the multiple surfaces that are higher priority than a second subset of the plurality of surfaces. The method includes transmitting the fist subset of multiple surfaces to the AR headset for display and transmitting the second subset of multiple surfaces to the AR headset for display after transmitting the first subset. This method includes rendering the surfaces in accordance with a set of rendering parameters so as to satisfy one or more network constraints.