-
公开(公告)号：US12141888B1
公开(公告)日：2024-11-12
申请号：US17127670
申请日：2020-12-18
Applicant: Meta Platforms Technologies, LLC
Inventor： Andrew Samuel Berkovich , Allie Del Giorno
IPC: G06T1/20 , G06T3/40 , G06T3/4053 , G06T7/55
Abstract: In one example, an apparatus is provided. The apparatus is part of a mobile device and comprises: an array of pixel cells each configured to perform an image sensing operation, one or more attributes of the image sensing operation being configurable based on an image sensing configuration; a sensor data processor configured to execute a hierarchical set of processing operations; and a controller configured to: receive, from the sensor data processor, a first-level processing output from a first-level processing operation of the hierarchical set of processing operations; and based on the first-level processing output satisfying a condition, control the sensor data processor to execute a second-level processing operation on at least one image frame captured by the array of pixel cells to generate a second-level processing output.
-
公开(公告)号：US12124623B1
公开(公告)日：2024-10-22
申请号：US17954583
申请日：2022-09-28
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Andrew Samuel Berkovich , Reid Frederick Pinkham
CPC classification number: G06F3/013 , G06T19/006
Abstract: Various embodiments set forth computer vision systems. In some embodiments, one or more activation maps are generated based on eye gaze data and used to control operation of one or more sensors. Each activation map indicates a highest density for acquiring sensor data in a region corresponding to an eye gaze direction and lower densities for acquiring sensor data in other regions. After the sensor data is acquired, a processing pipeline sub-samples (or bins) and processes regions of the acquired sensor data at different ratios based on the eye gaze direction. The sub-sampled (or binned) data for each region is processed independently, and results of the processing are combined to generate processed data, such as an image that can be displayed to a user.
-
公开(公告)号：US11595602B2
公开(公告)日：2023-02-28
申请号：US16672427
申请日：2019-11-01
Applicant: Meta Platforms Technologies, LLC
Inventor： Wei Gao , Andrew Samuel Berkovich , Song Chen , Tsung-Hsun Tsai , Xinqiao Liu
Abstract: Methods and systems for quantizing a physical quantity, such as light, are provided. In one example, an apparatus comprises an analog-to-digital (A/D) converter configured to generate raw digital outputs based on performing at least one of: (1) a first quantization operation to quantize a physical stimulus within a first intensity range based on a first A/D conversion relationship, or (2) a second quantization operation to quantize the physical stimulus within a second intensity range based on a second A/D conversion relationship; and a raw output conversion circuit configured generate a refined digital output based on a raw digital output obtained from the A/D converter and at least one predetermined conversion parameter. The at least one conversion parameter compensates for a discontinuity between the first A/D conversion relationship and the second A/D conversion relationship.
-
公开(公告)号：US12075175B1
公开(公告)日：2024-08-27
申请号：US17469258
申请日：2021-09-08
Applicant: Meta Platforms Technologies, LLC
Inventor： Andrew Samuel Berkovich , Shlomo Alkalay
IPC: H04N25/75
CPC classification number: H04N25/75
Abstract: In some examples, a sensor apparatus comprises: an array of pixel cells configured to generate a charge in response to light and convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data comprising one or more pixel values, and an on-sensor controller configured to receive the first digital pixel data from the ADC, determine first pixel values and second pixel values, generate second digital pixel data comprising the first pixel values and not the second pixel values, and send the second digital pixel data off-sensor. The on-sensor controller may generate a control signal to alter the rate of charge generation by the array of pixel cells. The digital image data may be generated using a compressed map of pixels.
-
公开(公告)号：US11888002B2
公开(公告)日：2024-01-30
申请号：US16716050
申请日：2019-12-16
Applicant: Meta Platforms Technologies, LLC
Inventor： Andrew Samuel Berkovich , Xinqiao Liu , Hans Reyserhove
IPC: H04N5/3745 , H04N5/341 , H04N5/369 , H04N5/232 , G06V10/25 , H01L27/146 , H04N25/77 , H04N23/617 , H04N25/40 , H04N25/709 , G06V30/24 , G06V10/764 , G06V10/82 , G06V10/147 , G06V20/20
CPC classification number: H01L27/14609 , G06V10/147 , G06V10/25 , G06V10/764 , G06V10/82 , G06V20/20 , G06V30/2504 , H04N23/617 , H04N25/40 , H04N25/709 , H04N25/77
Abstract: In one example, an apparatus comprises: an image sensor comprising an array of pixel cells, each pixel cell including a photodiode and circuits to generate image data, the photodiodes formed in a first semiconductor substrate; and a controller formed in one or more second semiconductor substrates that include the circuits of the array of pixel cells, the first and second semiconductor substrates forming a stack and housed within a semiconductor package. The controller is configured to: determine whether first image data generated by the image sensor contain features of an object; based on whether the first image data contain the features of the object, generate programming signals for the image sensor; and control, based on the programming signals, the image sensor to generate second image data.
-
Patent Agency Ranking
公开(公告)号：US11825228B2
公开(公告)日：2023-11-21
申请号：US17324803
申请日：2021-05-19
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Andrew Samuel Berkovich , Shlomo Alkalay , Hans Reyserhove
IPC: H04N5/3745 , H04N5/378 , H04N5/369 , H04N25/771 , H04N25/50 , H04N25/75 , H04N25/709
CPC classification number: H04N25/771 , H04N25/50 , H04N25/709 , H04N25/75
Abstract: In some examples, an apparatus comprises an array of pixel cells, and processing circuits associated with blocks of pixel cells of the array of pixel cells and associated with first hierarchical power domains. The apparatus further includes banks of memory devices, each bank of memory devices being associated with a block of pixel cells, to store the quantization results of the associated block of pixel cells, the banks of memory devices further being associated with second hierarchical power domains. The apparatus further includes a processing circuits power state control circuit configured to control a power state of the processing circuits based on programming data targeted at each block of pixel cells and global processing circuits power state control signals, and a memory power state control circuit configured to control a power state of the banks of memory devices based on the programming data and global memory power state control signals.
-
公开(公告)号：US11804010B2
公开(公告)日：2023-10-31
申请号：US18069896
申请日：2022-12-21
Applicant: Meta Platforms Technologies, LLC
Inventor： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
CPC classification number: G06T17/10 , G06T7/97 , G06T17/20 , G06T19/006
Abstract: In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.
-
公开(公告)号：US20230239582A1
公开(公告)日：2023-07-27
申请号：US18148834
申请日：2022-12-30
Applicant: Meta Platforms Technologies, LLC
Inventor： Andrew Samuel Berkovich , Xinqiao Liu
IPC: H04N23/84 , H04N25/772 , H01L27/146 , G02B27/01
CPC classification number: H04N23/84 , H04N25/772 , H01L27/14641 , H01L27/14645 , G02B27/017 , G02B2027/0178
Abstract: In some examples, a sensor apparatus comprises: an array of pixel cells each including one or more photodiodes configured to generate a charge in response to light, and a charge storage device to convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data, and an on-sensor controller configured to input the first pixel data into a machine-learning model to generate output data comprising prediction data associated with one or more features of the first pixel data, generate, based on the prediction data, second pixel data, the second pixel data associated with one or more transformed features of the first pixel data, and send, from the sensor apparatus to a separate receiving apparatus, the second pixel data.
-
公开(公告)号：US11562534B2
公开(公告)日：2023-01-24
申请号：US17541907
申请日：2021-12-03
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
Abstract: In one embodiment, a method includes instructing, at a first time, a camera having a plurality of pixel sensors to capture a first image of an environment comprising an object to determine a first object pose; determining, based on the first object pose, a predicted object pose of the object at a second time; generating pixel-activation instructions based on a buffer region around a projection of a 3D model of the object having the predicted object pose onto a virtual image plane associated with a predicted camera pose, where the size of the buffer region may be dependent on predicted dynamics for the object; instructing, at the second time, the camera to use a subset of the plurality of pixel sensors to capture a second image of the environment according to the pixel-activation instructions, and; determining, based on the second image, a second object pose of the object.
-
公开(公告)号：US12249092B2
公开(公告)日：2025-03-11
申请号：US17493620
申请日：2021-10-04
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Amr Suleiman , Anastasios Mourikis , Armin Alaghi , Andrew Samuel Berkovich , Shlomo Alkalay , Muzaffer Kal , Vincent Lee , Richard Andrew Newcombe
Abstract: In one embodiment, a computing system accesses a set of 3D locations associated with features in an environment previously captured by a camera from a previous camera pose. The computing system determines a predicted camera pose using the previous camera pose and motion measurements generated using a motion sensor associated with the camera. The computing system projects the set of 3D locations toward the predicted camera pose and onto a 2D image plane associated with the camera. The computing system generates, based on the projected set of 3D locations on the 2D image plane, an activation map specifying a subset of the pixel sensors of the camera that are to be activated. The computing system instructs, using the activation map, the camera to activate the subset of pixel sensors to capture a new image of the environment. The computing system reads pixel values of the new image.
-
-
-
-
-
-
-
-
-
Search Results
30
records
(took 0.019 seconds)
