公开(公告)号：US11888002B2

公开(公告)日：2024-01-30

申请号：US16716050

申请日：2019-12-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu ,  Hans Reyserhove

IPC: H04N5/3745 ,  H04N5/341 ,  H04N5/369 ,  H04N5/232 ,  G06V10/25 ,  H01L27/146 ,  H04N25/77 ,  H04N23/617 ,  H04N25/40 ,  H04N25/709 ,  G06V30/24 ,  G06V10/764 ,  G06V10/82 ,  G06V10/147 ,  G06V20/20

CPC classification number: H01L27/14609 ,  G06V10/147 ,  G06V10/25 ,  G06V10/764 ,  G06V10/82 ,  G06V20/20 ,  G06V30/2504 ,  H04N23/617 ,  H04N25/40 ,  H04N25/709 ,  H04N25/77

Abstract: In one example, an apparatus comprises: an image sensor comprising an array of pixel cells, each pixel cell including a photodiode and circuits to generate image data, the photodiodes formed in a first semiconductor substrate; and a controller formed in one or more second semiconductor substrates that include the circuits of the array of pixel cells, the first and second semiconductor substrates forming a stack and housed within a semiconductor package. The controller is configured to: determine whether first image data generated by the image sensor contain features of an object; based on whether the first image data contain the features of the object, generate programming signals for the image sensor; and control, based on the programming signals, the image sensor to generate second image data.

公开(公告)号：US11825228B2

公开(公告)日：2023-11-21

申请号：US17324803

申请日：2021-05-19

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Andrew Samuel Berkovich ,  Shlomo Alkalay ,  Hans Reyserhove

IPC: H04N5/3745 ,  H04N5/378 ,  H04N5/369 ,  H04N25/771 ,  H04N25/50 ,  H04N25/75 ,  H04N25/709

CPC classification number: H04N25/771 ,  H04N25/50 ,  H04N25/709 ,  H04N25/75

Abstract: In some examples, an apparatus comprises an array of pixel cells, and processing circuits associated with blocks of pixel cells of the array of pixel cells and associated with first hierarchical power domains. The apparatus further includes banks of memory devices, each bank of memory devices being associated with a block of pixel cells, to store the quantization results of the associated block of pixel cells, the banks of memory devices further being associated with second hierarchical power domains. The apparatus further includes a processing circuits power state control circuit configured to control a power state of the processing circuits based on programming data targeted at each block of pixel cells and global processing circuits power state control signals, and a memory power state control circuit configured to control a power state of the banks of memory devices based on the programming data and global memory power state control signals.

公开(公告)号：US11962928B2

公开(公告)日：2024-04-16

申请号：US16715792

申请日：2019-12-16

Applicant: Meta Platforms Technologies, LLC

Inventor： Hans Reyserhove ,  Andrew Samuel Berkovich ,  Xinqiao Liu

IPC: H04N23/73

CPC classification number: H04N23/73

Abstract: In one example, an apparatus includes an array of pixel cells and a peripheral circuit. Each pixel cell of the array of pixel cells includes: a memory to store pixel-level programming data and measurement data, and light measurement circuits configured to, based on the pixel-level programming data from the control memory, perform a light measurement operation to generate the measurement data, and to store the measurement data at the data memory. The peripheral circuit is configured to: receive a pixel array programming map including pixel-level programming data targeted at each pixel cell; extract the pixel-level programming data from the pixel array programming map; and transmit the pixel-level programming data to each pixel cell of the array of pixel cells for storage at the memory of the each pixel cell and to individually control the light measurement operation and a generation of the measurement data at the each pixel cell.

公开(公告)号：US11960638B2

公开(公告)日：2024-04-16

申请号：US17992648

申请日：2022-11-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu ,  Hans Reyserhove

IPC: G02B27/01 ,  G06F3/01 ,  G06F18/25 ,  G06V10/94 ,  G06V20/20 ,  G06V40/19 ,  H04N7/22 ,  H04N23/45 ,  H04N23/698

CPC classification number: G06F3/011 ,  G06F18/251 ,  G06V10/95 ,  G06V20/20 ,  G06V40/19 ,  H04N7/22 ,  H04N23/45 ,  H04N23/698

Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.

公开(公告)号：US20230080288A1

公开(公告)日：2023-03-16

申请号：US17992648

申请日：2022-11-22

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Xinqiao Liu ,  Hans Reyserhove

IPC: G06V20/20 ,  G06K9/62 ,  H04N7/22 ,  H04N5/232 ,  H04N5/225

Abstract: In one example, a mobile device comprises: a physical link; a plurality of image sensors, each image sensor being configured to transmit image data via the physical link; and a controller coupled to the physical link, whereby the physical link, the plurality of image sensors, and the controller form a multi-drop network. The controller is configured to: transmit a control signal to configure image sensing operations at the plurality of image sensors; receive, via the physical link, image data from at least a subset of the plurality of image sensors; combine the image data from the at least a subset of the plurality of image sensors to obtain an extended field of view (FOV); determine information of a surrounding environment of the mobile device captured within the extended FOV; and provide the information to an application to generate content based on the information.

公开(公告)号：US11568609B1

公开(公告)日：2023-01-31

申请号：US17315056

申请日：2021-05-07

Applicant: Meta Platforms Technologies, LLC

Inventor： Xinqiao Liu ,  Barbara De Salvo ,  Hans Reyserhove ,  Ziyun Li ,  Asif Imtiaz Khan ,  Syed Shakib Sarwar

IPC: G06T19/00 ,  G06F3/01 ,  G06T7/73 ,  G02B27/01 ,  G06V20/20 ,  G06K9/62 ,  G06V10/44 ,  G06V10/94 ,  G06V20/64 ,  G06V30/192 ,  H04N5/378 ,  H01L27/146 ,  H01L31/0352 ,  H01L31/0384 ,  H01L27/28 ,  H01L27/30

Abstract: In one example, an apparatus comprises: a first sensor layer, including an array of pixel cells configured to generate pixel data; and one or more semiconductor layers located beneath the first sensor layer with the one or more semiconductor layers being electrically connected to the first sensor layer via interconnects. The one or more semiconductor layers comprises on-chip compute circuits configured to receive the pixel data via the interconnects and process the pixel data, the on-chip compute circuits comprising: a machine learning (ML) model accelerator configured to implement a convolutional neural network (CNN) model to process the pixel data; a first memory to store coefficients of the CNN model and instruction codes; a second memory to store the pixel data of a frame; and a controller configured to execute the codes to control operations of the ML model accelerator, the first memory, and the second memory.