公开(公告)号：US20240144431A1

公开(公告)日：2024-05-02

申请号：US18497862

申请日：2023-10-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Zheng Shi ,  Grace Elizabeth Kuo ,  Yujia Chen ,  Daniel Andersen ,  Chao Li ,  Richard Andrew Newcombe ,  Michael Goesele

IPC: G06T3/40 ,  G02B27/42 ,  G06T5/20 ,  G06T5/50 ,  G06T7/11 ,  H04N23/88 ,  H04N23/90 ,  H04N23/951

CPC classification number: G06T3/4053 ,  G02B27/4205 ,  G06T5/20 ,  G06T5/50 ,  G06T7/11 ,  H04N23/88 ,  H04N23/90 ,  H04N23/951 ,  G06T2207/20021 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221

Abstract: In particular embodiments, a computing system may capture a first image of a scene using a first camera of an artificial reality device. The system may capture a second image of the scene using a second camera and one or more optical elements of the artificial reality device. The second image may include an overlapping portion of multiple shifted copies of the scene. The system may generate an upsampled first image by applying a particular sampling technique to the first image. The system may generate a tiled image comprising a plurality of repeated second images by applying a tiling process to the second image. The system may generate an initial output image by processing the upsampled first image and the tiled image using a machine learning model. The system may generate a final output image by normalizing the initial output image using the upsampled first image.

公开(公告)号：US20240119609A1

公开(公告)日：2024-04-11

申请号：US18484195

申请日：2023-10-10

Applicant: Meta Platforms Technologies, LLC

Inventor： Michael Goesele ,  Richard Andrew Newcombe ,  Yujia Chen ,  Florian Eddy Robert Ilg ,  Daniel Andersen ,  Chao Li ,  Simon Gareth Green

IPC: G06T7/292 ,  G06N3/02 ,  G06T7/246

CPC classification number: G06T7/292 ,  G06N3/02 ,  G06T7/246

Abstract: A distributed imaging system for augmented reality devices is disclosed. The system includes a computing module in communication with a plurality of spatially distributed sensing devices. The computing module is configured to process input images from the sensing devices based on performing a local feature matching computation to generate corresponding first output images. The computing module is further configured to process the input images based on performing an optical flow correspondence computation to generate corresponding second output images. The computing module is further configured to computationally combine first and second output images to generate third output images.