公开(公告)号：US11037968B2

公开(公告)日：2021-06-15

申请号：US16376634

申请日：2019-04-05

Applicant: Waymo LLC

Inventor： Lucian Ion ,  Vlad Constantin Cardei ,  Carl Warren Craddock

IPC: H01L27/146 ,  G06N3/08 ,  G06K9/32 ,  H04N5/232 ,  H04N5/341 ,  G06N3/067 ,  G06N3/02 ,  G06N3/04

Abstract: A image sensor includes a first integrated circuit layer including pixel sensors that are grouped based on position into pixel sensor groups, a second integrated circuit layer in electrical communication with the first integrated circuit layer, the second integrated circuit layer including image processing circuitry groups that are configured to each receive pixel information from a corresponding pixel sensor group, the image processing circuitry groups further configured to perform image processing operations on the pixel information to provide processed pixel information during operation of the image sensor, a third integrated circuit layer in electrical communication with the second integrated circuit layer, and the third integrated circuit layer including neural network circuitry groups that are configured to each receive the processed pixel information from a corresponding image processing circuitry group and perform analysis for object detection on the processed pixel information during operation of the image sensor.

公开(公告)号：US20230359216A1

公开(公告)日：2023-11-09

申请号：US18352787

申请日：2023-07-14

Applicant: Waymo LLC

Inventor： Vlad Constantin Cardei

IPC: G05D1/02 ,  G05D1/00

CPC classification number: G05D1/0231 ,  G05D1/0033

Abstract: Methods, systems, and apparatus, for an autonomous vehicle navigation maintenance system. In one aspect, an autonomous vehicle monitoring system includes a mounting surface located on an autonomous vehicle, and a thermal imaging system affixed to the mounting surface, the thermal imaging system including a thermal imaging camera, a replaceable filter, and a filter fixture configured to affix the replaceable filter to the thermal imaging camera and aligned with an optical axis of the thermal imaging camera, and where maintenance of the replaceable filter does not include re-calibrating the thermal imaging camera.

公开(公告)号：US11776163B1

公开(公告)日：2023-10-03

申请号：US17138247

申请日：2020-12-30

Applicant: Waymo LLC

Inventor： Vlad Constantin Cardei ,  Carl Warren Craddock

IPC: G06T7/90 ,  G06F17/16 ,  G06T11/00

CPC classification number: G06T7/90 ,  G06F17/16 ,  G06T11/001

Abstract: Systems, apparatus, and methods are presented for rendering color images. One method may include receiving first color values of a first image from a first image capture device. The first color values may represent colors in a first color space. The method also may include applying first color transformation information to the first color values to generate first transformed color values of the first image in a particular color space and applying desaturation information to the first transformed color values to generate first desaturated color values of the first image. Further, the method may include providing the first desaturated color values of the first image for rendering on a display device.

公开(公告)号：US11740636B2

公开(公告)日：2023-08-29

申请号：US16928538

申请日：2020-07-14

Applicant: Waymo LLC

Inventor： Vlad Constantin Cardei

IPC: G05D1/02 ,  G05D1/00

CPC classification number: G05D1/0231 ,  G05D1/0033

Abstract: Methods, systems, and apparatus, for an autonomous vehicle navigation maintenance system. In one aspect, an autonomous vehicle monitoring system includes a mounting surface located on an autonomous vehicle, and a thermal imaging system affixed to the mounting surface, the thermal imaging system including a thermal imaging camera, a replaceable filter, and a filter fixture configured to affix the replaceable filter to the thermal imaging camera and aligned with an optical axis of the thermal imaging camera, and where maintenance of the replaceable filter does not include re-calibrating the thermal imaging camera.

公开(公告)号：US20220076402A1

公开(公告)日：2022-03-10

申请号：US17526170

申请日：2021-11-15

Applicant: Waymo LLC

Inventor： Lucian Ion ,  Vlad Constantin Cardei

IPC: G06T7/00 ,  G06N3/063 ,  G06K9/00

Abstract: A method includes obtaining multiple images captured by pixel sensors of an image sensor, analyzing, using neural network circuitry integrated in the image sensor, the multiple images for object detection, generating, for each of the multiple images using the neural network circuitry integrated in the image sensor, neural network output data related to results of the analysis of the multiple images for object detection, and transmitting, from the image sensor, the neural network output data for each of the multiple images and image data for a subset of the multiple images instead of image data of each of the multiple images.