公开(公告)号：US12124623B1

公开(公告)日：2024-10-22

申请号：US17954583

申请日：2022-09-28

Applicant: META PLATFORMS TECHNOLOGIES, LLC

Inventor： Andrew Samuel Berkovich ,  Reid Frederick Pinkham

IPC: G06F3/01 ,  G06T19/00

CPC classification number: G06F3/013 ,  G06T19/006

Abstract: Various embodiments set forth computer vision systems. In some embodiments, one or more activation maps are generated based on eye gaze data and used to control operation of one or more sensors. Each activation map indicates a highest density for acquiring sensor data in a region corresponding to an eye gaze direction and lower densities for acquiring sensor data in other regions. After the sensor data is acquired, a processing pipeline sub-samples (or bins) and processes regions of the acquired sensor data at different ratios based on the eye gaze direction. The sub-sampled (or binned) data for each region is processed independently, and results of the processing are combined to generate processed data, such as an image that can be displayed to a user.

公开(公告)号：US20250013300A1

公开(公告)日：2025-01-09

申请号：US18887042

申请日：2024-09-17

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Reid Frederick Pinkham

IPC: G06F3/01 ,  G06T19/00

Abstract: Eye gaze data is generated by an eye-tracking module. One or more activation maps are generated by a sensing module based on the eye gaze data. The sensing module acquires sensor data based on the one or more activation maps.

公开(公告)号：US20240007771A1

公开(公告)日：2024-01-04

申请号：US18208236

申请日：2023-06-09

Applicant: Meta Platforms Technologies, LLC

Inventor： Andrew Samuel Berkovich ,  Jack Thomas Lavier ,  Reid Frederick Pinkham ,  Shlomo Alkalay

IPC: H04N25/78 ,  H04N25/40

CPC classification number: H04N25/78 ,  H04N25/40

Abstract: Systems and readout methods for foveated sensing may include a pixel array, readout circuitry, and processing logic. The pixel array may have a number of pixels. The readout circuitry may be configured to read image data from the pixel array for each of the plurality of pixels. The processing logic may be configured to identify a number of regions of interest (ROIs) within the pixel array. The processing logic may be configured to associate the image data for the pixels with one or more ROIs. The processing logic may be configured to arrange the image data into data frames. The data frames may include the image data ordered by ROI. Image data for inactive pixels may be removed from the image data and data frames prior to transmission. The processing logic may be configured to transmit the data frames in an order that is based on the ROIs.