Programmable smart sensor with adaptive readout

    公开(公告)号:US12075175B1

    公开(公告)日:2024-08-27

    申请号:US17469258

    申请日:2021-09-08

    CPC classification number: H04N25/75

    Abstract: In some examples, a sensor apparatus comprises: an array of pixel cells configured to generate a charge in response to light and convert the charge to output a voltage of an array of voltages, one or more an analog-to-digital converter (ADC) configured the convert the array of voltages to first pixel data comprising one or more pixel values, and an on-sensor controller configured to receive the first digital pixel data from the ADC, determine first pixel values and second pixel values, generate second digital pixel data comprising the first pixel values and not the second pixel values, and send the second digital pixel data off-sensor. The on-sensor controller may generate a control signal to alter the rate of charge generation by the array of pixel cells. The digital image data may be generated using a compressed map of pixels.

    Programmable pixel array having multiple power domains

    公开(公告)号:US11825228B2

    公开(公告)日:2023-11-21

    申请号:US17324803

    申请日:2021-05-19

    CPC classification number: H04N25/771 H04N25/50 H04N25/709 H04N25/75

    Abstract: In some examples, an apparatus comprises an array of pixel cells, and processing circuits associated with blocks of pixel cells of the array of pixel cells and associated with first hierarchical power domains. The apparatus further includes banks of memory devices, each bank of memory devices being associated with a block of pixel cells, to store the quantization results of the associated block of pixel cells, the banks of memory devices further being associated with second hierarchical power domains. The apparatus further includes a processing circuits power state control circuit configured to control a power state of the processing circuits based on programming data targeted at each block of pixel cells and global processing circuits power state control signals, and a memory power state control circuit configured to control a power state of the banks of memory devices based on the programming data and global memory power state control signals.

    Visual inertial odometry localization using sparse sensors

    公开(公告)号:US12249092B2

    公开(公告)日:2025-03-11

    申请号:US17493620

    申请日:2021-10-04

    Abstract: In one embodiment, a computing system accesses a set of 3D locations associated with features in an environment previously captured by a camera from a previous camera pose. The computing system determines a predicted camera pose using the previous camera pose and motion measurements generated using a motion sensor associated with the camera. The computing system projects the set of 3D locations toward the predicted camera pose and onto a 2D image plane associated with the camera. The computing system generates, based on the projected set of 3D locations on the 2D image plane, an activation map specifying a subset of the pixel sensors of the camera that are to be activated. The computing system instructs, using the activation map, the camera to activate the subset of pixel sensors to capture a new image of the environment. The computing system reads pixel values of the new image.

    READOUT METHODS FOR FOVEATED SENSING
    5.
    发明公开

    公开(公告)号:US20240007771A1

    公开(公告)日:2024-01-04

    申请号:US18208236

    申请日:2023-06-09

    CPC classification number: H04N25/78 H04N25/40

    Abstract: Systems and readout methods for foveated sensing may include a pixel array, readout circuitry, and processing logic. The pixel array may have a number of pixels. The readout circuitry may be configured to read image data from the pixel array for each of the plurality of pixels. The processing logic may be configured to identify a number of regions of interest (ROIs) within the pixel array. The processing logic may be configured to associate the image data for the pixels with one or more ROIs. The processing logic may be configured to arrange the image data into data frames. The data frames may include the image data ordered by ROI. Image data for inactive pixels may be removed from the image data and data frames prior to transmission. The processing logic may be configured to transmit the data frames in an order that is based on the ROIs.

Patent Agency Ranking