-
公开(公告)号:US11604509B1
公开(公告)日:2023-03-14
申请号:US16673702
申请日:2019-11-04
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu
Abstract: Methods and systems for sensing physical quantities are provided. In one example, an apparatus comprises: a plurality of sensing elements, each sensing element being configured to measure a physical quantity and to generate a measurement result; and a controller configured to: receive first measurement results from at least a subset of the plurality of sensing elements, each of the first measurement results corresponding to an event based at least in part on satisfying a relationship with a threshold; populate an event matrix based in part on the first measurement results; populate a change matrix based in part on the threshold; and generate information related to a distribution of the measurement results among the plurality of sensing elements based at least in part on the event matrix and the change matrix.
-
公开(公告)号:US20220405553A1
公开(公告)日:2022-12-22
申请号:US17833402
申请日:2022-06-06
Applicant: Meta Platforms Technologies, LLC
Inventor: Ziyun Li , Xinqiao Liu , Yiming Gan
Abstract: In one example, an apparatus comprises: a memory to store input data and weights, the input data comprising groups of data elements, each group being associated with a channel of channels, the weights comprising weight tensors, each weight tensor being associated with a channel of the channels; a data sparsity map generation circuit configured to generate, based on the input data, a channel sparsity map and a spatial sparsity map, the channel sparsity map indicating channels associated with first weights tensors to be selected, the spatial sparsity map indicating spatial locations of first data elements; a gating circuit configured to: fetch, based on the channel sparsity map and the sparsity map, the first weights tensors and the first data elements from the memory; and a processing circuit configured to perform neural network computations on the first data elements and the first weights tensors to generate a processing result.
-
公开(公告)号:US20250028389A1
公开(公告)日:2025-01-23
申请号:US18909167
申请日:2024-10-08
Applicant: Meta Platforms Technologies, LLC
Inventor: Qing Chao , Robert Dale Cavin , Guillaume Lestoquoy , Mohammadhossein Daraeihajitooei , Xinqiao Liu , Raffaele Capoccia , Sascha Hallstein , Ziyun Li
Abstract: Imaging signals are generated in response to image light. Event signals are generated in response to receive the imaging signals from imaging pixels. A Region of Interest (ROI) of the imaging pixels is identified from a spatial concentration of event signals in the ROI of imaging pixels within a time period. An ROI portion of the imaging pixels in the ROI are driven to capture an ROI image frame.
-
公开(公告)号:US11962928B2
公开(公告)日:2024-04-16
申请号:US16715792
申请日:2019-12-16
Applicant: Meta Platforms Technologies, LLC
Inventor: Hans Reyserhove , Andrew Samuel Berkovich , Xinqiao Liu
IPC: H04N23/73
CPC classification number: H04N23/73
Abstract: In one example, an apparatus includes an array of pixel cells and a peripheral circuit. Each pixel cell of the array of pixel cells includes: a memory to store pixel-level programming data and measurement data, and light measurement circuits configured to, based on the pixel-level programming data from the control memory, perform a light measurement operation to generate the measurement data, and to store the measurement data at the data memory. The peripheral circuit is configured to: receive a pixel array programming map including pixel-level programming data targeted at each pixel cell; extract the pixel-level programming data from the pixel array programming map; and transmit the pixel-level programming data to each pixel cell of the array of pixel cells for storage at the memory of the each pixel cell and to individually control the light measurement operation and a generation of the measurement data at the each pixel cell.
-
公开(公告)号:US11960638B2
公开(公告)日:2024-04-16
申请号:US17992648
申请日:2022-11-22
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Hans Reyserhove
IPC: G02B27/01 , G06F3/01 , G06F18/25 , G06V10/94 , G06V20/20 , G06V40/19 , H04N7/22 , H04N23/45 , H04N23/698
CPC classification number: G06F3/011 , G06F18/251 , G06V10/95 , G06V20/20 , G06V40/19 , H04N7/22 , H04N23/45 , H04N23/698
Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.
-
公开(公告)号:US11936998B1
公开(公告)日:2024-03-19
申请号:US17072840
申请日:2020-10-16
Applicant: Meta Platforms Technologies, LLC
Inventor: Tsung-Hsun Tsai , Lu Jie , Xinqiao Liu
Abstract: In one example, an apparatus comprises: a photodiode configured to generate a charge in response to light within an exposure period, a charge sensing unit configured to accumulate at least a part of the charge as an overflow charge, a quantizer, and a controller configured to: within a first time within the exposure period, control the quantizer to perform a first quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a first measurement output; within a second time after the first time, and within the exposure period, control the quantizer to perform a second quantization operation to quantize the overflow charge accumulated at the charge sensing unit to generate a second measurement output; and generate a digital output to represent an intensity of the light based on at least one of the first measurement output or the second measurement output.
-
公开(公告)号:US11906353B2
公开(公告)日:2024-02-20
申请号:US16435451
申请日:2019-06-07
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu , Song Chen , Andrew Samuel Berkovich , Wei Gao
IPC: G01J1/44
CPC classification number: G01J1/44 , G01J2001/446
Abstract: In one example, an apparatus comprises a photodiode, a charge storage unit, and a processing circuits configured to: transfer overflow charge from the photodiode to the charge storage unit to develop a first voltage; compare the first voltage against a first ramping threshold voltage to generate a first decision; generate, based on the first decision, a first digital value; transfer residual charge from the photodiode to the charge storage unit to develop a second voltage; compare the second voltage against a static threshold voltage to determine whether the photodiode saturates to generate a second decision; compare the second voltage against a second ramping threshold voltage to generate a third decision; generate, based on the third decision, a second digital value; and output, based on the second decision, one of the first digital value or the second digital value to represent an intensity of light received by the photodiode.
-
公开(公告)号:US11877080B2
公开(公告)日:2024-01-16
申请号:US17538092
申请日:2021-11-30
Applicant: Meta Platforms Technologies, LLC
Inventor: Xinqiao Liu , Song Chen , Tsung-Hsun Tsai
IPC: H04N25/75 , H01L27/146 , H04N23/73 , H04N25/77 , G02B27/01
CPC classification number: H04N25/75 , H01L27/14643 , H04N23/73 , H04N25/77 , G02B27/0172 , G02B2027/0178
Abstract: An apparatus comprises a first photodiode, a second photodiode, a quantizer, a memory, and a controller configured to: set a first exposure period in which the first photodiode generates a first charge; set a second exposure period in which the second photodiode generates a second charge, the second exposure period being set based on the first exposure period and at least one of: a first time associated with a read out operation of the memory to a second apparatus, or a second time associated with a quantization operation by the quantizer; perform, using the quantizer, the first quantization operation of the first charge to generate a first digital output; and perform, using the quantizer, a second quantization operation of the second charge to generate a second digital output.
-
公开(公告)号:US11703323B2
公开(公告)日:2023-07-18
申请号:US17230109
申请日:2021-04-14
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor: Michael Hall , Xinqiao Liu , Zhaoming Zhu , Rajesh Lachhmandas Chhabria , Huixuan Tang , Shuochen Su
IPC: G06T7/00 , G01B11/25 , G06T7/521 , G06T7/529 , G02B27/01 , G06T7/11 , G06T7/174 , G01B11/22 , G06T7/55 , G06T7/90 , H04N13/106 , H04N13/204 , G06T7/593 , H04N13/128 , H04N13/271 , H04N13/239 , H04N23/56 , G06V10/22 , G06V10/145 , H04N13/00
CPC classification number: G01B11/2513 , G01B11/22 , G02B27/0172 , G06T7/11 , G06T7/174 , G06T7/521 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/90 , G06T7/97 , G06V10/145 , G06V10/22 , H04N13/106 , H04N13/128 , H04N13/204 , H04N13/239 , H04N13/271 , H04N23/56 , G02B2027/014 , G02B2027/0138 , G02B2027/0178 , G06T2207/10028 , H04N2013/0081
Abstract: A depth estimation system is described capable of determining depth information using two images from two cameras. A first camera captures a first image and a second camera captures a second image, both images including a plurality of light channels. A scan direction is selected from a plurality of scan directions. For the selected scan direction, along each of a plurality of scanlines, the system compares pixels from the first image to pixels from the second image. The comparison is based on calculating a census transform for each pixel in the first image and a census transform for each pixel in the second image. This comparison is used to determine a stereo correspondence between the pixels in the first image and the pixels in the second image. The system generates a depth map based on the stereo correspondence.
-
公开(公告)号:US20230080288A1
公开(公告)日:2023-03-16
申请号:US17992648
申请日:2022-11-22
Applicant: Meta Platforms Technologies, LLC
Inventor: Andrew Samuel Berkovich , Xinqiao Liu , Hans Reyserhove
Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.
-
-
-
-
-
-
-
-
-