-
公开(公告)号:US20240118423A1
公开(公告)日:2024-04-11
申请号:US18484762
申请日:2023-10-11
Applicant: Meta Platforms Technologies, LLC
Inventor: Onur Can Akkaya , Song Chen , Xinqiao Liu , Andrew Samuel Berkovich , Tsung-Hsun Tsai , Yi Zheng , Raffaele Capoccia
IPC: G01S17/894 , G01S7/487 , G01S17/42
CPC classification number: G01S17/894 , G01S7/4873 , G01S17/42
Abstract: A projector sequentially generates light pulses to form a sparse grid array. The light pulses reflect off objects in an environment and are reflected towards a sensor array. The sensor array sequentially senses the reflected light pulses across pixels of the sensor array. A depth sensing system calculates depth information of objects in the environment based on the sequential nature of the pulse generation and the pulse sensing. The depth sensing system calculates depth information based on both the positional and temporal information of generated light pulses, and the positional and temporal information of sensed light pulses. The depth sensing system may generate a representation of the environment based on the depth information.
-
公开(公告)号:US20240114263A1
公开(公告)日:2024-04-04
申请号:US18479765
申请日:2023-10-02
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Onur Can Akkaya , Tsung-Hsun Tsai , Song Chen , Lyle David Bainbridge
IPC: H04N25/772 , H04N25/531 , H04N25/532
CPC classification number: H04N25/772 , H04N25/531 , H04N25/532
Abstract: An image-sensing system includes multiple sensing modules. Each of the multiple sensing modules includes multiple optical sensors arranged in an array. Each of the multiple sensors is configured to be switched on and off to generate analog sensing data. The image-sensing system also includes an analog-to-digital converter (ADC) shared by the multiple optical sensors configured to convert analog sensing data generated by the multiple optical sensors into digital data. The image-sensing system also includes a processor configured to control the multiple sensing modules.
-
公开(公告)号:US11943561B2
公开(公告)日:2024-03-26
申请号:US16896130
申请日:2020-06-08
Applicant: Meta Platforms Technologies, LLC
Inventor: Tsung-Hsun Tsai , Xinqiao Liu
IPC: H04N25/533 , H04N25/71 , H04N25/75
CPC classification number: H04N25/533 , H04N25/745 , H04N25/75
Abstract: In one example, an apparatus comprises: a photodiode to generate a charge in response to light within an exposure period having a first duration; a charge sensing unit to accumulate at least a part of the charge within the exposure period; a quantizer; and a controller to: determine, using the quantizer and within a measurement period having a second duration, whether a first quantity of the at least a part of the charge accumulated at the charge sensing unit exceeds a threshold, and a time it takes for the first quantity to exceed the threshold, wherein the first duration and the second duration are individually programmable; and based on whether the first quantity exceeds the threshold, output a first value representing the time or a second value representing a second quantity of the charge generated by the photodiode within the exposure period to represent an intensity of the light.
-
公开(公告)号:US11927475B2
公开(公告)日:2024-03-12
申请号:US16820594
申请日:2020-03-16
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Xinqiao Liu
IPC: G01J1/18 , G01J1/02 , G01J1/08 , G01J1/16 , G01J1/42 , G01J1/44 , H01L27/146 , H01L31/0203 , H04N5/357 , H04N5/359 , H04N5/369 , H04N5/3745 , H01L27/32
CPC classification number: G01J1/18 , G01J1/0228 , G01J1/08 , G01J1/1626 , G01J1/4228 , G01J1/44 , H01L27/14612 , H01L27/14634 , H01L27/1464 , H01L31/0203 , H04N5/357 , H04N5/3591 , H04N5/3594 , H04N5/37455 , H04N5/379 , H01L27/14636 , H01L27/14643 , H01L27/3227
Abstract: In one example, an apparatus comprises: a photodiode configured to generate charge in response to incident light within an exposure period; and a quantizer configured to perform at least one of a first quantization operation to generate a first digital output or a second quantization to generate a second digital output, and output, based on a range of an intensity of the incident light, one of the first digital output or the second digital output to represent the intensity of the incident light. The first quantization operation comprises quantizing at least a first part of the charge during the exposure period to generate the first digital output. The second quantization operation comprises quantizing at least a second part of the charge after the exposure period to generate the second digital output.
-
公开(公告)号:US11902685B1
公开(公告)日:2024-02-13
申请号:US17242152
申请日:2021-04-27
Applicant: Meta Platforms Technologies, LLC
Inventor: Tsung-Hsun Tsai , Song Chen , Xinqiao Liu
IPC: H04N5/335 , H04N25/63 , H04N25/772 , H04N25/75
CPC classification number: H04N25/772 , H04N25/63 , H04N25/75
Abstract: In one example, an apparatus comprises an array of pixel cells, each pixel cell including: a photodiode to generate a charge in response to incident light, a charge sensing unit configured to generate a voltage based on the charge, a quantizer configured to generate a digital output based on quantizing the voltage, and an in-pixel memory configured to store the digital output. The apparatus further includes a bus interface, an off-array frame memory, and a frame memory controller configured to: control the frame memory to receive, via the set of parallel interconnects, the digital outputs from the in-pixel memory of each pixel cell of the array of pixel cells; store the digital outputs in the frame memory; fetch the digital outputs from the frame memory; and transmit the digital outputs to a host device via the bus interface.
-
公开(公告)号:US11863886B2
公开(公告)日:2024-01-02
申请号:US17591300
申请日:2022-02-02
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Song Chen , Nicholas Daniel Trail , Michael Patrick Schaub
Abstract: In one example, an apparatus comprises: multiple distinct sets of photodiodes, wherein each set of photodiodes includes one or more photodiodes, one or more charge sensing units, and a controller. The controller is configured to: transfer charge generated by the one or more photodiodes in response to a different component of incident light to the one or more charge sensing units in order to convert the charge to voltages; perform one or more quantization processes of a plurality of quantization processes corresponding to a plurality of intensity ranges, wherein the one or more quantization processes quantizes the voltages from the one or more charge sensing units to digital values representing components of a pixel of different wavelength ranges; and generate a pixel value based on the at least some of the digital values.
-
公开(公告)号:US11823498B1
公开(公告)日:2023-11-21
申请号:US17384209
申请日:2021-07-23
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Chengde Wan , Randi Cabezas , Xinqiao Liu , Ziyun Li
Abstract: The disclosed computer-implemented method may include (1) receiving a present frame of a video stream, the present frame comprising a present depiction of a multi-segment articulated body system, (2) identifying a previous frame of the video stream that comprises a previous depiction of the multi-segment articulated body system, (3) analyzing the present frame and the previous frame to determine whether the multi-segment articulated body system remained substantially rigid between the previous frame and the present frame, and (4) estimating a pose of the multi-segment articulated body system in the present frame using a first pose estimation computation that treats the multi-segment articulated body system as rigid and that is selected in contrast to a second pose estimation computation based on determining that the multi-segment articulated body system remained substantially rigid between the previous frame and the present frame. Various other methods, systems, and computer-readable media are also disclosed.
-
38.
公开(公告)号:US11740075B2
公开(公告)日:2023-08-29
申请号:US17504004
申请日:2021-10-18
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Michael Hall , Xinqiao Liu , Zhaoming Zhu , Rajesh Lachhmandas Chhabria , Huixuan Tang , Shuochen Su , Zihe Gao
IPC: G06T7/521 , G01B11/22 , G01B11/25 , G06T7/529 , G02B27/01 , G06T7/11 , G06T7/174 , G06T7/55 , G06T7/00 , G06T7/90 , H04N13/106 , H04N13/204 , G06T7/593 , H04N13/128 , H04N13/271 , H04N13/239 , H04N23/56 , G06V10/22 , G06V10/145 , H04N13/00
CPC classification number: G01B11/2513 , G01B11/22 , G02B27/0172 , G06T7/11 , G06T7/174 , G06T7/521 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/90 , G06T7/97 , G06V10/145 , G06V10/22 , H04N13/106 , H04N13/128 , H04N13/204 , H04N13/239 , H04N13/271 , H04N23/56 , G02B2027/014 , G02B2027/0138 , G02B2027/0178 , G06T2207/10028 , H04N2013/0081
Abstract: A depth camera assembly (DCA) determines depth information. The DCA projects a dynamic structured light pattern into a local area and captures images including a portion of the dynamic structured light pattern. The DCA determines regions of interest in which it may be beneficial to increase or decrease an amount of texture added to the region of interest using the dynamic structured light pattern. For example, the DCA may identify the regions of interest based on contrast values calculated using a contrast algorithm, or based on the parameters received from a mapping server including a virtual model of the local area. The DCA may selectively increase or decrease an amount of texture added by the dynamic structured light pattern in portions of the local area. By selectively controlling portions of the dynamic structured light pattern, the DCA may decrease power consumption and/or increase the accuracy of depth sensing measurements.
-
公开(公告)号:US20230037261A1
公开(公告)日:2023-02-02
申请号:US17865223
申请日:2022-07-14
Applicant: Meta Platforms Technologies, LLC
Inventor: Qing Chao , Lu Lu , Xinqiao Liu , Hao Yu , Junren Wang
Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.
-
公开(公告)号:US11568609B1
公开(公告)日:2023-01-31
申请号:US17315056
申请日:2021-05-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu , Barbara De Salvo , Hans Reyserhove , Ziyun Li , Asif Imtiaz Khan , Syed Shakib Sarwar
IPC: G06T19/00 , G06F3/01 , G06T7/73 , G02B27/01 , G06V20/20 , G06K9/62 , G06V10/44 , G06V10/94 , G06V20/64 , G06V30/192 , H04N5/378 , H01L27/146 , H01L31/0352 , H01L31/0384 , H01L27/28 , H01L27/30
Abstract: In one example, an apparatus comprises: a first sensor layer, including an array of pixel cells configured to generate pixel data; and one or more semiconductor layers located beneath the first sensor layer with the one or more semiconductor layers being electrically connected to the first sensor layer via interconnects. The one or more semiconductor layers comprises on-chip compute circuits configured to receive the pixel data via the interconnects and process the pixel data, the on-chip compute circuits comprising: a machine learning (ML) model accelerator configured to implement a convolutional neural network (CNN) model to process the pixel data; a first memory to store coefficients of the CNN model and instruction codes; a second memory to store the pixel data of a frame; and a controller configured to execute the codes to control operations of the ML model accelerator, the first memory, and the second memory.
-
-
-
-
-
-
-
-
-