IMAGE SENSOR ARCHITECTURE
    21.
    发明申请

    公开(公告)号:US20200321374A1

    公开(公告)日:2020-10-08

    申请号:US16376634

    申请日:2019-04-05

    Applicant: Waymo LLC

    Abstract: A image sensor includes a first integrated circuit layer including pixel sensors that are grouped based on position into pixel sensor groups, a second integrated circuit layer in electrical communication with the first integrated circuit layer, the second integrated circuit layer including image processing circuitry groups that are configured to each receive pixel information from a corresponding pixel sensor group, the image processing circuitry groups further configured to perform image processing operations on the pixel information to provide processed pixel information during operation of the image sensor, a third integrated circuit layer in electrical communication with the second integrated circuit layer, and the third integrated circuit layer including neural network circuitry groups that are configured to each receive the processed pixel information from a corresponding image processing circuitry group and perform analysis for object detection on the processed pixel information during operation of the image sensor.

    3D ToF Vision System
    22.
    发明申请

    公开(公告)号:US20250080872A1

    公开(公告)日:2025-03-06

    申请号:US18819678

    申请日:2024-08-29

    Applicant: Waymo LLC

    Abstract: Example embodiments relate to devices, systems, and methods involving three-dimensional time-of-flight/visible image sensors. An example embodiment includes a device that includes a plurality of time of flight sensor (ToF) pixels and a plurality of visible image sensor (VIS) pixels. The device also includes a ToF communication channel configured to provide ToF image data indicative of one or more ToF pixels and a VIS communication channel configured to provide VIS image data indicative of one or more VIS pixels. The plurality of ToF pixels and the plurality of VIS pixels are arranged along a plane. The plurality of ToF pixels is disposed in an arrangement among the plurality of VIS pixels.

    Infrared light module uniformity rotational test module

    公开(公告)号:US12241618B2

    公开(公告)日:2025-03-04

    申请号:US18413494

    申请日:2024-01-16

    Applicant: Waymo LLC

    Abstract: Example embodiments described herein involve a system for testing a light-emitting module. The light-emitting module may include a mounting platform configured to hold a light-emitting module for a camera. The mounting platform may also be configured to rotate. The system may further include a housing holding a plurality of photodiodes arranged in an array over at least a 90 degree arc of a hemisphere. The system may also include a controller configured to control the photodiodes and the rotation of the mounting platform.

    High bandwidth camera data transmission

    公开(公告)号:US12147891B2

    公开(公告)日:2024-11-19

    申请号:US17526170

    申请日:2021-11-15

    Applicant: Waymo LLC

    Abstract: A method includes obtaining multiple images captured by pixel sensors of an image sensor, analyzing, using neural network circuitry integrated in the image sensor, the multiple images for object detection, generating, for each of the multiple images using the neural network circuitry integrated in the image sensor, neural network output data related to results of the analysis of the multiple images for object detection, and transmitting, from the image sensor, the neural network output data for each of the multiple images and image data for a subset of the multiple images instead of image data of each of the multiple images.

    Smart Sensor Scheduler
    27.
    发明公开

    公开(公告)号:US20230300477A1

    公开(公告)日:2023-09-21

    申请号:US18323093

    申请日:2023-05-24

    Applicant: Waymo LLC

    Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), image processing resources, and a scheduler configured to perform operations including determining a priority level for a particular ROI of the plurality of ROIs based on a feature detected by one or more image processing resources of the image processing resources within initial image data associated with the particular ROI. The operations also include selecting, based on the feature detected within the initial image data, a particular image processing resource of the image processing resources by which subsequent image data generated by the particular ROI is to be processed. The operations further include inserting, based on the priority level, the subsequent image data into a processing queue of the particular image processing resource to schedule the subsequent image data for processing by the particular image processing resource.

    Smart sensor implementations of region of interest operating modes

    公开(公告)号:US11756283B2

    公开(公告)日:2023-09-12

    申请号:US17123440

    申请日:2020-12-16

    Applicant: Waymo LLC

    Abstract: A system includes an image sensor having a plurality of pixels that form a plurality of regions of interest (ROIs), and configured to operate at a frame rate higher than a threshold rate. The system also includes an image processing resource. The system further includes control circuitry configured to perform operations that include obtaining, from the image sensor, a full-resolution image of an environment. The full-resolution image contains each respective ROI of the plurality of ROIs. The operations also include selecting a particular ROI based on the full-resolution image, and detecting an object of interest in the particular ROI. The operations include determining a mode of operation by which subsequent image data generated by the particular ROI is to be processed. The operations further include processing, based on the mode of operation and the frame rate, the image data comprising a plurality of ROI images of the object of interest.

    Microlensing for Real-Time Sensing of Stray Light

    公开(公告)号:US20230269484A1

    公开(公告)日:2023-08-24

    申请号:US18308390

    申请日:2023-04-27

    Applicant: Waymo LLC

    CPC classification number: H04N23/71 G05D1/0231 H04N23/10 H04N23/76 H04N25/60

    Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.

    Microlensing for real-time sensing of stray light

    公开(公告)号:US11678059B2

    公开(公告)日:2023-06-13

    申请号:US17659922

    申请日:2022-04-20

    Applicant: Waymo LLC

    CPC classification number: H04N23/71 G05D1/0231 H04N23/10 H04N23/76 H04N25/60

    Abstract: Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.

Patent Agency Ranking