公开(公告)号：US11948089B2

公开(公告)日：2024-04-02

申请号：US17091331

申请日：2020-11-06

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Andrew Samuel Berkovich ,  Reid Pinkham

IPC: H04N5/232 ,  G06N3/04 ,  G06N3/08 ,  G06N3/084 ,  G06V10/141 ,  G06V10/147 ,  G06V10/94 ,  G06V20/20 ,  H04N23/61

CPC classification number: G06N3/084 ,  G06N3/04 ,  G06N3/08 ,  G06V10/141 ,  G06V10/147 ,  G06V10/95 ,  G06V10/955 ,  G06V20/20 ,  H04N23/61

Abstract: In one example, an apparatus comprises: an image sensor comprising a plurality of pixel cells; a frame buffer; and a sensor compute circuit configured to: receive, from the frame buffer, a first image frame comprising first active pixels and first inactive pixels, the first active pixels being generated by a first subset of the pixel cells selected based on first programming data; perform an image-processing operation on a first subset of pixels of the first image frame, whereby a second subset of pixels of the first image frame are excluded from the image-processing operation, to generate a processing output; based on the processing output, generate second programming data; and transmit the second programming data to the image sensor to select a second subset of the pixel cells to generate second active pixels for a second image frame.

公开(公告)号：US12108141B2

公开(公告)日：2024-10-01

申请号：US16983863

申请日：2020-08-03

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Reid Pinkham ,  Tanner Schmidt

IPC: H04N23/617 ,  G06N3/02 ,  H01L27/146 ,  H04N23/60 ,  H04N23/80 ,  H04N25/443

CPC classification number: H04N23/617 ,  G06N3/02 ,  H01L27/14634 ,  H01L27/14636 ,  H04N23/665 ,  H04N23/80 ,  H04N25/443

Abstract: In one example, an apparatus comprises a pixel cell array and a controller formed within a semiconductor package. The pixel cell array is configured to: generate, at a first time and based on first programming signals received from the controller, a first image frame; transmit the first image frame to a host processor; and transmit the first image frame or a second image frame to the controller, the second image frame being generated at the first time and having a different sparsity of pixels from the first image frame. The controller is configured to receive second programming signals from a host processor, the second programming signals being determined by the host processor based on the first image frame; update the first programming signals based on the second programming signals; and control the pixel cell array to generate a subsequent image frame based on the updated first programming signals.