-
公开(公告)号:US12140763B1
公开(公告)日:2024-11-12
申请号:US18206856
申请日:2023-06-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Zhaoming Zhu , Mark Timothy Sullivan , Jonatan Ginzburg
Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.
-
公开(公告)号:US20220413284A1
公开(公告)日:2022-12-29
申请号:US16261531
申请日:2019-01-29
Applicant: Meta Platforms Technologies, LLC
Inventor: Qing Chao , Zhaoming Zhu
Abstract: A depth camera assembly (DCA) has a light source assembly, a mask, a camera assembly, and a controller. The light source assembly includes at least one light source. The mask is configured to generate an interference pattern that is projected into a target area. The mask has two openings configured to pass through light emitted by the at least one light source, and the light passed through the two openings forms an interference pattern across the target area. The interference pattern has a phase based on a position of the light source. The camera assembly is configured to capture images of a portion of the target area that includes the interference pattern. The controller is configured to determine depth information for the portion of the target area based on the captured images.
-
公开(公告)号:US20230280468A1
公开(公告)日:2023-09-07
申请号:US17748777
申请日:2022-05-19
Applicant: Meta Platforms Technologies, LLC
Inventor: Zhaoming Zhu , Michael Hall , Augusto Ronchini Ximenes , Shuochen Su , Charles Patrick Saunders , Gregory Cohoon
IPC: G01S17/894 , G02B27/00 , G01B11/22 , G01S7/4865 , G01S7/481 , G06T7/521 , G06F3/01
CPC classification number: G01S17/894 , G01B11/22 , G01S7/4815 , G01S7/4865 , G02B27/0093 , G06F3/013 , G06T7/521
Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters having a plurality of subarrays and an optical assembly. Each subarray includes one or more independently addressable channels emitting light in accordance with emission instructions. At least two of the subarrays are adjacent to each other and do not overlap. The optical assembly is configured to tile portions of the emitted light to form a light pattern for projection to a target area. The light pattern has a first plurality of sections and a second plurality of sections. Each section of the first plurality represents a first respective portion of the light pattern emitted from a corresponding subarray. Each section of the second plurality represents a second respective portion of the light pattern formed by tiling light emitted from two or more of the subarrays.
-
公开(公告)号:US11733524B1
公开(公告)日:2023-08-22
申请号:US17329799
申请日:2021-05-25
Applicant: Meta Platforms Technologies, LLC
Inventor: Zhaoming Zhu , Nicholas Daniel Trail
CPC classification number: G02B27/0172 , G01S17/10 , G06T7/70 , G02B2027/0178
Abstract: A depth camera assembly for depth sensing of a local area includes an illumination source, an imaging device, and a controller. The illumination source illuminates a local area with light emitted in accordance with emission instructions generated by the controller. The illumination source includes an array of optical sources and an optical assembly. Operation of each optical source in the array is controllable based in part on the emission instructions. The optical assembly is configured to project the light into the local area. The imaging device captures one or more images of at least a portion of the light reflected from one or more objects in the local area. The controller determines depth information for the one or more objects based in part on the captured one or more images.
-
公开(公告)号:US11747523B1
公开(公告)日:2023-09-05
申请号:US17370749
申请日:2021-07-08
Applicant: Meta Platforms Technologies, LLC
Inventor: Zhaoming Zhu
IPC: G02B3/00 , G02B27/01 , H04N13/271 , H01S5/42 , H01S5/183
CPC classification number: G02B3/0037 , G02B27/0172 , H04N13/271 , H01S5/183 , H01S5/423
Abstract: A dot array illuminator includes an illumination source that includes one or more source arrays and a microlens array (MLA). A source array is an array of light emitting components. The source arrays are positioned on a substrate according to a geometric configuration. The MLA includes lens arrays that are arranged in a similar geometric configuration. The microlens array are separated from the source arrays by a distance and are substantially parallel to the source arrays. The microlens array overlaps with the source arrays and is of a dimension such that it can receive substantially all light emitted by the illumination source. The illumination source emits light towards the MLA. The MLA receives the light and outputs structured pattern light by interpolating received light.
-
6.
公开(公告)号:US11740075B2
公开(公告)日:2023-08-29
申请号:US17504004
申请日:2021-10-18
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Michael Hall , Xinqiao Liu , Zhaoming Zhu , Rajesh Lachhmandas Chhabria , Huixuan Tang , Shuochen Su , Zihe Gao
IPC: G06T7/521 , G01B11/22 , G01B11/25 , G06T7/529 , G02B27/01 , G06T7/11 , G06T7/174 , G06T7/55 , G06T7/00 , G06T7/90 , H04N13/106 , H04N13/204 , G06T7/593 , H04N13/128 , H04N13/271 , H04N13/239 , H04N23/56 , G06V10/22 , G06V10/145 , H04N13/00
CPC classification number: G01B11/2513 , G01B11/22 , G02B27/0172 , G06T7/11 , G06T7/174 , G06T7/521 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/90 , G06T7/97 , G06V10/145 , G06V10/22 , H04N13/106 , H04N13/128 , H04N13/204 , H04N13/239 , H04N13/271 , H04N23/56 , G02B2027/014 , G02B2027/0138 , G02B2027/0178 , G06T2207/10028 , H04N2013/0081
Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.
-
公开(公告)号:US11703323B2
公开(公告)日:2023-07-18
申请号:US17230109
申请日:2021-04-14
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Michael Hall , Xinqiao Liu , Zhaoming Zhu , Rajesh Lachhmandas Chhabria , Huixuan Tang , Shuochen Su
IPC: G06T7/00 , G01B11/25 , G06T7/521 , G06T7/529 , G02B27/01 , G06T7/11 , G06T7/174 , G01B11/22 , G06T7/55 , G06T7/90 , H04N13/106 , H04N13/204 , G06T7/593 , H04N13/128 , H04N13/271 , H04N13/239 , H04N23/56 , G06V10/22 , G06V10/145 , H04N13/00
CPC classification number: G01B11/2513 , G01B11/22 , G02B27/0172 , G06T7/11 , G06T7/174 , G06T7/521 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/90 , G06T7/97 , G06V10/145 , G06V10/22 , H04N13/106 , H04N13/128 , H04N13/204 , H04N13/239 , H04N13/271 , H04N23/56 , G02B2027/014 , G02B2027/0138 , G02B2027/0178 , G06T2207/10028 , H04N2013/0081
Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.
-
公开(公告)号:US11516457B2
公开(公告)日:2022-11-29
申请号:US17348469
申请日:2021-06-15
Applicant: Meta Platforms Technologies, LLC
Inventor: Zihe Gao , Michael Hall , Qing Chao , Zhaoming Zhu , Tin Komljenovic
IPC: G01B11/25 , H04N13/254 , G02B27/01 , G02F1/225
Abstract: A switchable fringe pattern illuminator includes an optical path switch configured to receive light and dynamically control an amount of light that is provided to a first waveguide and an amount of light that is provided to a second waveguide. A first projector configured to generate a first fringe pattern using light from the first waveguide. The first fringe pattern illuminates a first portion of a target area. A second projector configured to generate a second fringe pattern using light from the second waveguide. The second fringe pattern illuminates a second portion of a target area. The illuminator may be part of a depth camera assembly (DCA). The DCA is configured to capture images of a portion of the target area. The DCA is further configured to determine depth information for an object in the target area based in part on the captured images.
-
公开(公告)号:US11435528B1
公开(公告)日:2022-09-06
申请号:US16924676
申请日:2020-07-09
Applicant: Meta Platforms Technologies, LLC
Inventor: Zihe Gao , Zhaoming Zhu , Michael Hall , Guohua Wei
Abstract: A photonic integrated circuit assembly generates light for use in a display system or a depth sensing system. The photonic integrated circuit assembly includes optical conditioning elements integrated into a photonic integrated circuit. The photonic integrated circuit includes one or more light sources on the photonic integrated circuit. The photonic integrated circuit includes a waveguide and one or more gratings located in a core of the photonic integrated circuit. The gratings may collimate and/or collocate light emitted by the light source. The photonic integrated circuit may include a beam shaping element integrated into the photonic integrated circuit. A MEMS scanner may use the collocated and/or collimated light emitted by the photonic integrated circuit to generate a display for a user or to generate a structured light pattern for use in a depth sensing system.
-
公开(公告)号:US11709364B1
公开(公告)日:2023-07-25
申请号:US17728560
申请日:2022-04-25
Applicant: Meta Platforms Technologies, LLC
Inventor: Zhaoming Zhu , Mark Timothy Sullivan , Jonatan Ginzburg
CPC classification number: G02B27/0172 , G01S17/89 , G02B27/0179 , G03B21/2033 , G06F3/013 , G06T7/521 , H04N23/611 , G02B2027/0178 , G06T2207/10028 , H01S5/18302
Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.
-
-
-
-
-
-
-
-
-