公开(公告)号：US20230280468A1

公开(公告)日：2023-09-07

申请号：US17748777

申请日：2022-05-19

Applicant: Meta Platforms Technologies, LLC

Inventor： Zhaoming Zhu ,  Michael Hall ,  Augusto Ronchini Ximenes ,  Shuochen Su ,  Charles Patrick Saunders ,  Gregory Cohoon

IPC: G01S17/894 ,  G02B27/00 ,  G01B11/22 ,  G01S7/4865 ,  G01S7/481 ,  G06T7/521 ,  G06F3/01

CPC classification number: G01S17/894 ,  G01B11/22 ,  G01S7/4815 ,  G01S7/4865 ,  G02B27/0093 ,  G06F3/013 ,  G06T7/521

Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters having a plurality of subarrays and an optical assembly. Each subarray includes one or more independently addressable channels emitting light in accordance with emission instructions. At least two of the subarrays are adjacent to each other and do not overlap. The optical assembly is configured to tile portions of the emitted light to form a light pattern for projection to a target area. The light pattern has a first plurality of sections and a second plurality of sections. Each section of the first plurality represents a first respective portion of the light pattern emitted from a corresponding subarray. Each section of the second plurality represents a second respective portion of the light pattern formed by tiling light emitted from two or more of the subarrays.

公开(公告)号：US11703323B2

公开(公告)日：2023-07-18

申请号：US17230109

申请日：2021-04-14

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Michael Hall ,  Xinqiao Liu ,  Zhaoming Zhu ,  Rajesh Lachhmandas Chhabria ,  Huixuan Tang ,  Shuochen Su

IPC: G06T7/00 ,  G01B11/25 ,  G06T7/521 ,  G06T7/529 ,  G02B27/01 ,  G06T7/11 ,  G06T7/174 ,  G01B11/22 ,  G06T7/55 ,  G06T7/90 ,  H04N13/106 ,  H04N13/204 ,  G06T7/593 ,  H04N13/128 ,  H04N13/271 ,  H04N13/239 ,  H04N23/56 ,  G06V10/22 ,  G06V10/145 ,  H04N13/00

CPC classification number: G01B11/2513 ,  G01B11/22 ,  G02B27/0172 ,  G06T7/11 ,  G06T7/174 ,  G06T7/521 ,  G06T7/529 ,  G06T7/55 ,  G06T7/593 ,  G06T7/90 ,  G06T7/97 ,  G06V10/145 ,  G06V10/22 ,  H04N13/106 ,  H04N13/128 ,  H04N13/204 ,  H04N13/239 ,  H04N13/271 ,  H04N23/56 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0178 ,  G06T2207/10028 ,  H04N2013/0081

Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.

公开(公告)号：US11740075B2

公开(公告)日：2023-08-29

申请号：US17504004

申请日：2021-10-18

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Michael Hall ,  Xinqiao Liu ,  Zhaoming Zhu ,  Rajesh Lachhmandas Chhabria ,  Huixuan Tang ,  Shuochen Su ,  Zihe Gao

IPC: G06T7/521 ,  G01B11/22 ,  G01B11/25 ,  G06T7/529 ,  G02B27/01 ,  G06T7/11 ,  G06T7/174 ,  G06T7/55 ,  G06T7/00 ,  G06T7/90 ,  H04N13/106 ,  H04N13/204 ,  G06T7/593 ,  H04N13/128 ,  H04N13/271 ,  H04N13/239 ,  H04N23/56 ,  G06V10/22 ,  G06V10/145 ,  H04N13/00

CPC classification number: G01B11/2513 ,  G01B11/22 ,  G02B27/0172 ,  G06T7/11 ,  G06T7/174 ,  G06T7/521 ,  G06T7/529 ,  G06T7/55 ,  G06T7/593 ,  G06T7/90 ,  G06T7/97 ,  G06V10/145 ,  G06V10/22 ,  H04N13/106 ,  H04N13/128 ,  H04N13/204 ,  H04N13/239 ,  H04N13/271 ,  H04N23/56 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0178 ,  G06T2207/10028 ,  H04N2013/0081

Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.

公开(公告)号：US11601607B2

公开(公告)日：2023-03-07

申请号：US17069709

申请日：2020-10-13

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Rajesh Lachhmandas Chhabria ,  Shuochen Su ,  Monica Stewart ,  David Vakrat ,  Shengqiong Xie ,  Michael Hall

IPC: H04N5/33 ,  G02B27/00 ,  G02B27/01

Abstract: An electronic device includes one or more processors and memory storing instructions for execution by the one or more processors. The stored instructions include instructions for: receiving infrared image information for a three-dimensional area; receiving non-infrared image information for the same three-dimensional area; performing nonlinear intensity adjustment for the received infrared image information; performing nonlinear intensity adjustment for the received non-infrared image information; blending the intensity-adjusted infrared image information and the intensity-adjusted non-infrared image information to obtain a merged image information; and providing the merged image information for determining a depth map. Also disclosed are a corresponding method performed by the electronic device and a computer readable storage medium storing instructions for execution by one or more processors of an electronic device.

公开(公告)号：US20230260222A1

公开(公告)日：2023-08-17

申请号：US18087483

申请日：2022-12-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Brevin Tilmon ,  Shuochen Su ,  Michael Hall

IPC: G06T19/00 ,  G06V10/74 ,  H04N13/128 ,  G01S17/89

CPC classification number: G06T19/006 ,  G06V10/761 ,  H04N13/128 ,  G01S17/89 ,  H04N2013/0081

Abstract: A binary depth mask model is trained for use in occlusion within a mixed reality application. The training leverages information about virtual object positions and depths that is inherently available to the system as part of rendering of virtual objects. Training is performed on a set of stereo images, a set of binary depth masks corresponding to the stereo images, and a depth value against which object depth is evaluated. Given this input, the training outputs the binary depth mask model, which when given a stereo image as input outputs a depth binary depth mask indicating which pixels of the stereo image are nearer, or father away, than the depth value. The depth mask model can be applied in real time to handle occlusion operations when compositing a given real-world stereo image with virtual objects.

公开(公告)号：US11480684B2

公开(公告)日：2022-10-25

申请号：US17138537

申请日：2020-12-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Augusto Ronchini Ximenes ,  Michael Hall ,  Zhaoming Zhu ,  Shuochen Su

IPC: G01S17/894 ,  G02B27/01 ,  G01S17/86 ,  G01S7/4863

Abstract: A direct time of flight depth system includes an addressable illumination source, an active depth sensor, and a controller. The addressable illumination source includes an array of emitters and an optical assembly that is used to generate an array of dots emitted into a local area. Each emitter is independently addressable, allowing selective illumination of different portions of the local area. The addressable illumination source is aligned with the active depth sensor so each dot maps to a corresponding macropixel (e.g., 4×4 array of SPADs) on the active depth sensor. Data from the active depth sensor is readout and used to determine depth information.