公开(公告)号：US20240251176A1

公开(公告)日：2024-07-25

申请号：US18420349

申请日：2024-01-23

Applicant: Meta Platforms Technologies, LLC

Inventor： Nathan MATSUDA ,  Grace Elizabeth KUO ,  Douglas Robert LANMAN ,  Eric PENNER ,  Clinton SMITH ,  Seth MOCZYDLOWSKI ,  Alexander CHING

IPC: H04N23/957 ,  G02B27/01 ,  G06V10/10 ,  G06V40/18

CPC classification number: H04N23/957 ,  G02B27/0172 ,  G06V10/16 ,  G06V40/193

Abstract: According to examples, an image capture device may include a lens array including lenses supported by a lens support structure, in which the lenses are arranged to capture light rays from multiple view-points. The image capture device may also include a sensor to capture light and convert the captured light into data that is used to form an image and a plurality of apertures positioned between the lenses and the sensor, in which the apertures are positioned with respect to the lenses and the sensor to allow rays of light that would have reached a certain reference location spaced from the sensor to pass through the plurality of apertures. An optimization algorithm may be applied to the collected sensor data to reproduce an image of a scene at a perspective that is intended to match a virtual eye position that is offset from the location of the sensor.

公开(公告)号：US20240303910A1

公开(公告)日：2024-09-12

申请号：US18437161

申请日：2024-02-08

Applicant: Meta Platforms Technologies, LLC

Inventor： Lei XIAO ,  Douglas Robert LANMAN ,  Numair Khalil Ullah KHAN

IPC: G06T15/20 ,  G06T7/50 ,  G06T17/20

CPC classification number: G06T15/20 ,  G06T7/50 ,  G06T17/20

Abstract: A method for generating tiled multiplane images from a source image is disclosed. The method includes obtaining color and depth images. The method also includes extracting a feature map using a first neural network. The method also includes generating masks for a tile using a second neural network based on a corresponding tile of the feature map and corresponding sections of the color and depth images. The method also includes computing depths of a planes corresponding to the tile based on the masks. The method also includes generating a per-tile multiplane image for the tile based on the masks. The method also includes rendering an image using per-tile multiplane images and depths. A system for generating tiled multiplane images from a source image is also disclosed.

公开(公告)号：US20250106376A1

公开(公告)日：2025-03-27

申请号：US18976021

申请日：2024-12-10

Applicant: Meta Platforms Technologies, LLC

Inventor： Lei XIAO ,  Salah Eddine NOURI ,  Joel HEGLAND ,  Douglas Robert LANMAN

IPC: H04N13/344 ,  G02B30/22 ,  G06F1/16 ,  H04N13/00 ,  H04N13/156 ,  H04N13/257

Abstract: Apparatuses, systems, and methods are described for a head-mounted display (HMD) headset having a pass-through configuration for a stereoscopic view. The HMD may have right and left exterior-facing stereo cameras mounted on a front face of the HMD and in the same visual plane as the user's eyes, where the exterior-facing stereo cameras collect images for stereo view synthesis. The HMD may include a processor and a memory storing instructions, which, when executed by the processor, cause the processor to perform stereo view synthesis with a machine-learning (ML) based technique including at least disocclusion filtering, in which disocclusion hole regions may be substantially removed.

公开(公告)号：US20230305489A1

公开(公告)日：2023-09-28

申请号：US17702379

申请日：2022-03-23

Applicant: Meta Platforms Technologies, LLC

Inventor： Changwon JANG ,  Richard WEBB ,  Liang SHI ,  Lei XIAO ,  Changil KIM ,  Douglas Robert LANMAN

IPC: G03H1/02 ,  G03H1/04 ,  H04N19/91 ,  H04N19/124 ,  G06T19/00

CPC classification number: G03H1/024 ,  G03H1/04 ,  H04N19/91 ,  H04N19/124 ,  G06T19/006 ,  G03H2001/0088

Abstract: According to examples, a learning based, end-to-end compression system may include an encoder, which may receive a complex hologram image and encode a latent code for a real component and an imaginary component of the hologram image. The system may also include a quantizer to quantize the latent code and a transform block, which may entropy-code the quantized latent code to obtain a compressed image. The system may further include a generator to decode the compressed image and a discriminator, which may classify the decoded image to obtain an uncompressed image. In case of holographic video input, the encoder may encode a frame to obtain a standard compressed frame and a residual to a latent code. The generator may decode the standard compressed frame and the latent code to obtain a reconstructed residual, and the discriminator may combine the uncompressed standard frame and the reconstructed residual.

公开(公告)号：US20230168506A1

公开(公告)日：2023-06-01

申请号：US17540049

申请日：2021-12-01

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Gang LI ,  Brian WHEELWRIGHT ,  Andrew MAIMONE ,  Yang ZHAO ,  Ying GENG ,  Douglas Robert LANMAN

IPC: G02B27/01

CPC classification number: G02B27/0172 ,  G02B2027/0178 ,  G02B2027/0174

Abstract: A display device includes a display module for providing first image light. The display device also includes a first optical element for receiving and transmitting the first image light from the display module. The display module includes a region from which the first image light is provided in directions other than a direction perpendicular to the first optical element. The display device further includes a second optical element so that the second optical element receives the first image light transmitted through the first optical element and sends the received first image light back toward the first optical element as second image light. The first optical element receives the second image light from the second optical element and sends the second image light back toward the second optical element, and the second optical element receives and transmits the second image light from the first optical element.