-
公开(公告)号:US12108141B2
公开(公告)日:2024-10-01
申请号:US16983863
申请日:2020-08-03
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Reid Pinkham , Tanner Schmidt
IPC: H04N23/617 , G06N3/02 , H01L27/146 , H04N23/60 , H04N23/80 , H04N25/443
CPC classification number: H04N23/617 , G06N3/02 , H01L27/14634 , H01L27/14636 , H04N23/665 , H04N23/80 , H04N25/443
Abstract: In one example, an apparatus comprises a pixel cell array and a controller formed within a semiconductor package. The pixel cell array is configured to: generate, at a first time and based on first programming signals received from the controller, a first image frame; transmit the first image frame to a host processor; and transmit the first image frame or a second image frame to the controller, the second image frame being generated at the first time and having a different sparsity of pixels from the first image frame. The controller is configured to receive second programming signals from a host processor, the second programming signals being determined by the host processor based on the first image frame; update the first programming signals based on the second programming signals; and control the pixel cell array to generate a subsequent image frame based on the updated first programming signals.
-
公开(公告)号:US20240214709A1
公开(公告)日:2024-06-27
申请号:US18518216
申请日:2023-11-22
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich
IPC: H04N25/78 , H04N25/131
CPC classification number: H04N25/78 , H04N25/131
Abstract: A multi-mode sensor assembly is described. The sensor assembly includes a first die and a second die. The first die includes a pixel array composed of color pixels that detect light in one or more color channels and sparse pixels. The color pixels and the sparse pixels are arranged to form macro pixels, and each macro pixel includes a respective subset of the color pixels and a respective subset of the sparse pixels. The second die is positioned below and coupled to the first die. The second die includes an analog-to-digital converter (ADC) array that is communicatively coupled to the sparse pixels such that each subset of the sparse pixels has a single corresponding ADC in the ADC array.
-
公开(公告)号:US11962928B2
公开(公告)日:2024-04-16
申请号:US16715792
申请日:2019-12-16
Applicant: Meta Platforms Technologies, LLC
Inventor: Hans Reyserhove , Andrew Samuel Berkovich , Xinqiao Liu
IPC: H04N23/73
CPC classification number: H04N23/73
Abstract: In one example, an apparatus includes an array of pixel cells and a peripheral circuit. Each pixel cell of the array of pixel cells includes: a memory to store pixel-level programming data and measurement data, and light measurement circuits configured to, based on the pixel-level programming data from the control memory, perform a light measurement operation to generate the measurement data, and to store the measurement data at the data memory. The peripheral circuit is configured to: receive a pixel array programming map including pixel-level programming data targeted at each pixel cell; extract the pixel-level programming data from the pixel array programming map; and transmit the pixel-level programming data to each pixel cell of the array of pixel cells for storage at the memory of the each pixel cell and to individually control the light measurement operation and a generation of the measurement data at the each pixel cell.
-
公开(公告)号:US11960638B2
公开(公告)日:2024-04-16
申请号:US17992648
申请日:2022-11-22
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Hans Reyserhove
IPC: G02B27/01 , G06F3/01 , G06F18/25 , G06V10/94 , G06V20/20 , G06V40/19 , H04N7/22 , H04N23/45 , H04N23/698
CPC classification number: G06F3/011 , G06F18/251 , G06V10/95 , G06V20/20 , G06V40/19 , H04N7/22 , H04N23/45 , H04N23/698
Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.
-
公开(公告)号:US11906353B2
公开(公告)日:2024-02-20
申请号:US16435451
申请日:2019-06-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu , Song Chen , Andrew Samuel Berkovich , Wei Gao
IPC: G01J1/44
CPC classification number: G01J1/44 , G01J2001/446
Abstract: In one example, an apparatus comprises a photodiode, a charge storage unit, and a processing circuits configured to: transfer overflow charge from the photodiode to the charge storage unit to develop a first voltage; compare the first voltage against a first ramping threshold voltage to generate a first decision; generate, based on the first decision, a first digital value; transfer residual charge from the photodiode to the charge storage unit to develop a second voltage; compare the second voltage against a static threshold voltage to determine whether the photodiode saturates to generate a second decision; compare the second voltage against a second ramping threshold voltage to generate a third decision; generate, based on the third decision, a second digital value; and output, based on the second decision, one of the first digital value or the second digital value to represent an intensity of light received by the photodiode.
-
公开(公告)号:US20230080288A1
公开(公告)日:2023-03-16
申请号:US17992648
申请日:2022-11-22
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Hans Reyserhove
Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.
-
公开(公告)号:US12244936B2
公开(公告)日:2025-03-04
申请号:US18148834
申请日:2022-12-30
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu
IPC: H04N23/84 , G02B27/01 , H01L27/146 , H04N25/772
Abstract: In some examples, a sensor apparatus comprises: an array of pixel cells each including one or more photodiodes configured to generate a charge in response to light, and a charge storage device to convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data, and an on-sensor controller configured to input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data, generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data, and send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.
-
公开(公告)号:US20250013300A1
公开(公告)日:2025-01-09
申请号:US18887042
申请日:2024-09-17
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Reid Frederick Pinkham
Abstract: Eye gaze data is generated by an eye-tracking module. One or more activation maps are generated by a sensing module based on the eye gaze data. The sensing module acquires sensor data based on the one or more activation maps.
-
公开(公告)号:US11974044B2
公开(公告)日:2024-04-30
申请号:US17180207
申请日:2021-02-19
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu , Andrew Samuel Berkovich , Song Chen
IPC: H01L27/146 , F21V8/00 , G02B27/01 , G06V10/143 , G06V10/147 , G06V20/20 , G06V40/19 , H04N23/73 , H04N25/583 , H04N25/59 , H04N25/771 , H04N25/772
CPC classification number: H04N23/73 , G02B27/0172 , G06V10/143 , G06V10/147 , G06V40/19 , H01L27/14605 , H01L27/14612 , H04N25/583 , H04N25/59 , H04N25/771 , H04N25/772 , G02B6/0016 , G02B6/0036 , G02B2027/0112 , G02B2027/0118 , G02B2027/0138 , G02B2027/0178 , G02B27/0179 , G02B2027/0187 , G06V20/20 , H01L27/14621 , H01L27/14627 , H01L27/14636 , H01L27/1465 , H01L27/14652
Abstract: In one example, a method comprises: exposing a first photodiode to incident light to generate first charge; exposing a second photodiode to the incident light to generate second charge; converting, by a first charge sensing unit, the first charge to a first voltage; converting, by a second charge sensing unit, the second charge to a second voltage; controlling an ADC to detect, based on the first voltage, that a quantity of the first charge reaches a saturation threshold, and to measure a saturation time when the quantity of the first charge reaches the saturation threshold; stopping the exposure of the first photodiode and the second photodiode to the incident light based on detecting that the quantity of the first charge reaches the saturation threshold; and controlling the ADC to measure, based on the second voltage, a quantity of the second charge generated by the second photodiode before the exposure ends.
-
公开(公告)号:US11956413B2
公开(公告)日:2024-04-09
申请号:US16550851
申请日:2019-08-26
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Song Chen , Xinqiao Liu , Lyle David Bainbridge , Andrew Samuel Berkovich
IPC: H04N5/355 , H04N5/378 , H04N13/286
CPC classification number: H04N13/286 , H04N5/3559 , H04N5/378
Abstract: In one example, an apparatus comprises: a first photodiode to generate a first charge; a second photodiode to generate a second charge; a quantizer; a first memory bank and a second memory bank; and a controller configured to: control the quantizer to perform a first quantization operation and a second quantization operation of the first charge to generate, respectively, a first digital output and a second digital output, the first and second quantization operations being associated with different intensity ranges; store one of the first digital output or the second digital output in the first memory bank; control the quantizer to perform a third quantization operation of the second charge to generate a third digital output, the third quantization operation being associated with a different intensity range from at least one of the first or second quantization operations; and store the third digital output in the second memory bank.
-
-
-
-
-
-
-
-
-