公开(公告)号：US20230032925A1

公开(公告)日：2023-02-02

申请号：US17729951

申请日：2022-04-26

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Ziyun Li ,  Barbara De Salvo ,  Xinqiao Liu ,  Lyle David Bainbridge ,  Andrew Samuel Berkovich ,  Syed Shakib Sarwar ,  Song Chen ,  Tsung-Hsun Tsai

IPC: H04N5/232 ,  G06V10/147 ,  G06V10/94 ,  G06V10/10 ,  G06T7/20 ,  G06V10/70

Abstract: The disclosed system may include a first layer that includes multiple digital pixel sensors configured to detect light. The system may also include a second layer that includes various image processing components configured to process the light detected by the digital pixel sensors. Still further, the system may include a third layer that includes machine learning (ML) hardware processing components. The image processing components of the second layer may be communicatively connected to the ML hardware processing components of the third layer via multiple micro through-silicon vias (uTSVs). Various other methods of manufacturing, apparatuses, and computer-readable media are also disclosed.

公开(公告)号：US20230008674A1

公开(公告)日：2023-01-12

申请号：US17850898

申请日：2022-06-27

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Hao Yu ,  Lu Lu ,  Scott Charles McEldowney ,  Xinqiao Liu ,  Eric Fest

IPC: G02B5/30 ,  G02B3/00 ,  H04N5/369 ,  H04N5/33

Abstract: An image sensor includes imaging pixels and a patterned liquid crystal polarizer (LCP). The imaging pixel include subpixels. The patterned LCP is disposed over the subpixels and configured to direct a particular polarized portion of imaging light to particular subpixels.

公开(公告)号：US12231749B2

公开(公告)日：2025-02-18

申请号：US17865223

申请日：2022-07-14

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Lu Lu ,  Xinqiao Liu ,  Hao Yu ,  Junren Wang

IPC: H04N23/11 ,  G02B1/00 ,  G02B3/00 ,  G02B5/20 ,  G02B5/30 ,  G02B5/32 ,  H04N23/00

Abstract: Imaging systems, cameras, and image sensors of this disclosure include imaging pixels that include subpixels. Diffractive optical elements such as a metasurface lens layers or a liquid crystal polarization hologram (LCPH) are configured to focus image light to the subpixels of the imaging pixels.

公开(公告)号：US12147596B1

公开(公告)日：2024-11-19

申请号：US17896679

申请日：2022-08-26

Applicant: Meta Platforms Technologies, LLC

Inventor： Qing Chao ,  Robert Dale Cavin ,  Guillaume Lestoquoy ,  Mohammadhossein Daraeihajitooei ,  Xinqiao Liu ,  Raffaele Capoccia ,  Sascha Hallstein ,  Ziyun Li

IPC: G06F3/01 ,  G06T7/73 ,  G06V10/25 ,  G06V10/60 ,  G06V40/18 ,  H04N5/33

Abstract: An eyebox region is illuminated with a fringe illumination pattern. An event sensor is configured to generate event-signals. Eye motion is determined from the event-signals. Eye-features are extracted from data generated by the event sensors and a predicted gaze vector is generated from the eye-features.

公开(公告)号：US11956560B2

公开(公告)日：2024-04-09

申请号：US17496712

申请日：2021-10-07

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Tsung-Hsun Tsai ,  Song Chen ,  Xinqiao Liu

IPC: H04N5/3745 ,  H03M1/56 ,  H04N5/355 ,  H04N5/369 ,  H04N25/59 ,  H04N25/709 ,  H04N25/771 ,  H04N25/772 ,  H04N25/778

CPC classification number: H04N25/772 ,  H03M1/56 ,  H04N25/59 ,  H04N25/709 ,  H04N25/771 ,  H04N25/778

Abstract: In some examples, a sensor apparatus comprises: a pixel cell configured to generate a voltages, the pixel cell including a photodiode configured to generate charge in response to incoming light, and a charge storage device to convert the charge to a voltage; an integrated circuit configured to: determine a first captured voltage converted by the charge storage device during a first time period; compare the first captured voltage to a threshold voltage value; and in response to determining that the first captured voltage meets or exceeds the threshold voltage value: determine first time data corresponding to the first time period; and prevent the charge storage device from further generating a charge; and an analog-to-digital converter (ADC) configured to generate a digital pixel value based on the first captured voltage, and a memory to store the digital pixel value and the first time data.

公开(公告)号：US11935575B1

公开(公告)日：2024-03-19

申请号：US17556436

申请日：2021-12-20

Applicant: Meta Platforms Technologies, LLC

Inventor： Syed Shakib Sarwar ,  Ziyun Li ,  Xinqiao Liu ,  Barbara De Salvo

IPC: G11C11/16 ,  G06F1/16 ,  G11C11/404 ,  G11C11/412 ,  G11C11/54 ,  H03K19/017 ,  G11C11/4091 ,  G11C11/4096

CPC classification number: G11C11/4045 ,  G06F1/163 ,  G11C11/16 ,  G11C11/412 ,  G11C11/54 ,  H03K19/01742 ,  G11C11/4091 ,  G11C11/4096 ,  G02B27/017 ,  G02B2027/014 ,  G09G5/363 ,  G09G2360/18 ,  G06N3/08 ,  G06T1/60

Abstract: An example apparatus having a heterogenous memory system includes a first sensor layer, of a plurality of stacked sensor layers, including an array of pixels; and one or more semiconductor layers of the plurality of stacked sensor layers located beneath the first sensor layer, the one or more semiconductor layers configured to process pixel data output by the array of pixels, the one or more semiconductor layers including a first memory to store most significant bits (“MSBs”) of data involved in the processing of the pixel data; a second memory to store least significant bits (“LSBs”) of the data; and wherein the first memory has a lower bit error rate (“BER”) than the second memory.

公开(公告)号：US11924396B2

公开(公告)日：2024-03-05

申请号：US17579279

申请日：2022-01-19

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Michael Hall ,  Qing Chao ,  Byron Taylor ,  Xinqiao Liu

IPC: H04N13/271 ,  G01S17/89 ,  G02B26/08 ,  G02B27/01 ,  G02F1/1347 ,  G02F1/139 ,  G02F1/29 ,  G02F1/33 ,  G06F3/03 ,  G06T7/521 ,  H04N13/207 ,  H04N13/344 ,  H04N13/383 ,  G02B26/00

CPC classification number: H04N13/271 ,  G01S17/89 ,  G02B26/08 ,  G02B26/0808 ,  G02B27/0101 ,  G02B27/017 ,  G02F1/13471 ,  G02F1/1393 ,  G02F1/292 ,  G02F1/33 ,  G06F3/0325 ,  G06T7/521 ,  H04N13/207 ,  H04N13/344 ,  H04N13/383 ,  G02B26/004 ,  G02B2027/0138 ,  G02B2027/014 ,  G02F2201/305

Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a transmitter, a receiver, and a controller. The transmitter illuminates a local area with outgoing light in accordance with emission instructions. The transmitter includes a fine steering element and a coarse steering element. The fine steering element deflects one or more optical beams at a first deflection angle to generate one or more first order deflected scanning beams. The coarse steering element deflects the one or more first order deflected scanning beams at a second deflection angle to generate the outgoing light projected into the local area. The receiver captures one or more images of the local area including portions of the outgoing light reflected from the local area. The controller determines depth information for one or more objects in the local area based in part on the captured one or more images.

公开(公告)号：US11888002B2

公开(公告)日：2024-01-30

申请号：US16716050

申请日：2019-12-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu ,  Hans Reyserhove

IPC: H04N5/3745 ,  H04N5/341 ,  H04N5/369 ,  H04N5/232 ,  G06V10/25 ,  H01L27/146 ,  H04N25/77 ,  H04N23/617 ,  H04N25/40 ,  H04N25/709 ,  G06V30/24 ,  G06V10/764 ,  G06V10/82 ,  G06V10/147 ,  G06V20/20

CPC classification number: H01L27/14609 ,  G06V10/147 ,  G06V10/25 ,  G06V10/764 ,  G06V10/82 ,  G06V20/20 ,  G06V30/2504 ,  H04N23/617 ,  H04N25/40 ,  H04N25/709 ,  H04N25/77

Abstract: In one example, an apparatus comprises: an image sensor comprising an array of pixel cells, each pixel cell including a photodiode and circuits to generate image data, the photodiodes formed in a first semiconductor substrate; and a controller formed in one or more second semiconductor substrates that include the circuits of the array of pixel cells, the first and second semiconductor substrates forming a stack and housed within a semiconductor package. The controller is configured to: determine whether first image data generated by the image sensor contain features of an object; based on whether the first image data contain the features of the object, generate programming signals for the image sensor; and control, based on the programming signals, the image sensor to generate second image data.

公开(公告)号：US20230239582A1

公开(公告)日：2023-07-27

申请号：US18148834

申请日：2022-12-30

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu

IPC: H04N23/84 ,  H04N25/772 ,  H01L27/146 ,  G02B27/01

CPC classification number: H04N23/84 ,  H04N25/772 ,  H01L27/14641 ,  H01L27/14645 ,  G02B27/017 ,  G02B2027/0178

Abstract: In some examples, a sensor apparatus comprises: an array of pixel cells each including one or more photodiodes configured to generate a charge in response to light, and a charge storage device to convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data, and an on-sensor controller configured to input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data, generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data, and send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.

公开(公告)号：US20230092325A1

公开(公告)日：2023-03-23

申请号：US17931001

申请日：2022-09-09

Applicant: Meta Platforms Technologies, LLC

Inventor： Tsung-Hsun Tsai ,  Song Chen ,  Lyle David Bainbridge ,  Xinqiao Liu

IPC: H01L27/146 ,  H04N5/378 ,  H04N5/355 ,  H04N5/3745 ,  G02B27/01

Abstract: In one example, an apparatus comprises a first photodiode, a second photodiode, a first floating diffusion, a second floating diffusion, a quantizer, and a controller. The controller can enable the first photodiode and the second photodiode to generate and accumulate photo charge within an exposure period, and use the quantizer to quantize reset voltages at the first floating diffusion and at the second floating diffusion to generate a first digital reset value and a second digital reset value. After the exposure period ends, the controller can transfer the photo charge from the first photodiode and the second photodiode to, respectively, the first floating diffusion and the second floating diffusion to generate a first signal voltage and a second signal voltage, and quantize the signal voltages into digital signal values using the quantizer. Digital representations can be generated based on the digital reset values and the digital signal values.