-
公开(公告)号:US20240223882A1
公开(公告)日:2024-07-04
申请号:US18413521
申请日:2024-01-16
Applicant: Waymo LLC
Inventor: Andreas Wendel , Jeremy Dittmer , Brendan Hermalyn , Benjamin Ingram
IPC: H04N23/61 , H04N23/45 , H04N23/73 , H04N23/741
CPC classification number: H04N23/61 , H04N23/45 , H04N23/73 , H04N23/741
Abstract: Example embodiments relate to multiple operating modes to expand dynamic range. An example embodiment includes a camera system. The camera system may include a first image sensor having a first dynamic range corresponding to a first range of luminance levels in a scene. The system may also include a second image sensor having a second dynamic range corresponding to a second range of luminance levels in the scene. The camera system may further include a processor coupled to the first image sensor and the second image sensor. The processor may be configured to execute instructions to identify objects of a first type in a first image of the scene captured by the first image sensor and identify objects of a second object type in a second image of the scene captured by the second image sensor.
-
公开(公告)号:US20240080414A1
公开(公告)日:2024-03-07
申请号:US18388458
申请日:2023-11-09
Applicant: Waymo LLC
Inventor: Pierre-Yves Droz , Simon Verghese , Brendan Hermalyn
CPC classification number: H04N7/183 , G01S7/4812 , G01S7/4817 , G01S17/86 , G01S17/87 , G01S17/89 , G01S17/931 , H04N23/60 , H04N23/69 , B60R1/00
Abstract: Example implementations are provided for an arrangement of co-aligned rotating sensors. One example device includes a light detection and ranging (LIDAR) transmitter that emits light pulses toward a scene according to a pointing direction of the device. The device also includes a LIDAR receiver that detects reflections of the emitted light pulses reflecting from the scene. The device also includes an image sensor that captures an image of the scene based on at least external light originating from one or more external light sources. The device also includes a platform that supports the LIDAR transmitter, the LIDAR receiver, and the image sensor in a particular relative arrangement. The device also includes an actuator that rotates the platform about an axis to adjust the pointing direction of the device.
-
公开(公告)号:US20230393244A1
公开(公告)日:2023-12-07
申请号:US18229259
申请日:2023-08-02
Applicant: WAYMO LLC
Inventor: Kimberly Geneva Toth , Brendan Hermalyn , Shane Mcguire , Felix Jose Alvarez Rivera , Jeremy Dittmer , Andreas Wendel
CPC classification number: G01S7/4813 , G05D1/0246 , B60R11/04 , G05D1/0088 , H04N23/51 , G05D2201/0213 , B60R2300/102 , B60R2300/105
Abstract: The technology relates to autonomous vehicles that use a perception system to detect objects and features in the vehicle's surroundings. A camera assembly having a ring-type structure is provided that gives the perception system an overall 360° field of view around the vehicle. Image sensors are arranged in camera modules around the assembly to provide a seamless panoramic field of view. One subsystem has multiple pairs of image sensors positioned to provide the overall 360° field of view, while another subsystem provides a set of image sensors generally facing toward the front of the vehicle to provide enhanced object identification. The camera assembly may be arranged in a housing located on top of the vehicle. The housing may include other sensors such as LIDAR and radar. The assembly includes a chassis and top and base plates, which may provide EMI protection from other sensors disposed in the housing.
-
公开(公告)号:US11609313B2
公开(公告)日:2023-03-21
申请号:US16229193
申请日:2018-12-21
Applicant: Waymo LLC
Inventor: Caner Onal , David Schleuning , Brendan Hermalyn , Simon Verghese , Alex McCauley , Brandyn White , Ury Zhilinsky
IPC: G01S7/48 , G01S17/89 , G06T1/00 , G01S7/4865 , G01S7/481 , G01S17/931
Abstract: The present disclosure relates to systems and methods that provide both an image of a scene and depth information for the scene. An example system includes at least one time-of-flight (ToF) sensor and an imaging sensor. The ToF sensor and the imaging sensor are configured to receive light from a scene. The system also includes at least one light source and a controller that carries out operations. The operations include causing the at least one light source to illuminate at least a portion of the scene with illumination light according to an illumination schedule. The operations also include causing the at least one ToF sensor to provide information indicative of a depth map of the scene based on the illumination light. The operations additionally include causing the imaging sensor to provide information indicative of an image of the scene based on the illumination light.
-
公开(公告)号:US20230032410A1
公开(公告)日:2023-02-02
申请号:US17959170
申请日:2022-10-03
Applicant: Waymo LLC
Inventor: Pierre-Yves Droz , Simon Verghese , Brendan Hermalyn
Abstract: Example implementations are provided for an arrangement of co-aligned rotating sensors. One example device includes a light detection and ranging (LIDAR) transmitter that emits light pulses toward a scene according to a pointing direction of the device. The device also includes a LIDAR receiver that detects reflections of the emitted light pulses reflecting from the scene. The device also includes an image sensor that captures an image of the scene based on at least external light originating from one or more external light sources. The device also includes a platform that supports the LIDAR transmitter, the LIDAR receiver, and the image sensor in a particular relative arrangement. The device also includes an actuator that rotates the platform about an axis to adjust the pointing direction of the device.
-
公开(公告)号:US20210255443A1
公开(公告)日:2021-08-19
申请号:US17227285
申请日:2021-04-10
Applicant: Waymo LLC
Inventor: Brendan Hermalyn
Abstract: The present disclosure relates to optical systems. An example optical system includes at least one primary optical element configured to receive incident light from a scene and a plurality of relay mirrors optically coupled to the at least one primary optical element. The optical system also includes a lens optically coupled to the plurality of relay mirrors, and an image sensor configured to receive focused light from the lens. The image sensor includes a first light-sensitive area and a second light-sensitive area. The primary optical element, the plurality of relay mirrors, and the lens interact with the incident light to form a first focused light portion and a second focused light portion. The first focused light portion forms a first image portion of the scene on the first light-sensitive area and the second focused light portion forms a second image portion of the scene on the second light-sensitive area.
-
公开(公告)号:US10473903B2
公开(公告)日:2019-11-12
申请号:US15856194
申请日:2017-12-28
Applicant: Waymo LLC
Inventor: Brendan Hermalyn
Abstract: The present disclosure relates to multiple view optical systems. An example optical system includes at least one primary optical element configured to receive incident light from a scene and a plurality of relay mirrors optically coupled to the at least one primary optical element. The optical system also includes a lens optically coupled to the plurality of relay mirrors, and an image sensor configured to receive focused light from the lens. The image sensor includes a first light-sensitive area and a second light-sensitive area. The primary optical element, the plurality of relay mirrors, and the lens interact with the incident light to form a first focused light portion and a second focused light portion. The first focused light portion forms a first image portion of the scene on the first light-sensitive area and the second focused light portion forms a second image portion of the scene on the second light-sensitive area.
-
公开(公告)号:US20190208136A1
公开(公告)日:2019-07-04
申请号:US16214589
申请日:2018-12-10
Applicant: Waymo LLC
Inventor: Andreas Wendel , Jeremy Dittmer , Brendan Hermalyn
CPC classification number: H04N5/247 , B60R11/04 , B60R2011/0026 , B60R2011/004 , G05D1/0246 , G05D2201/0213 , G06T7/20 , G06T2207/30252 , H04N5/23229 , H04N5/917 , H04N7/12
Abstract: An optical system for a vehicle may be configured with a plurality of camera sensors. Each camera sensor may be configured to create respective image data of a respective field of view. The optical system is further configured with a plurality of image processing units coupled to the plurality of camera sensors. The image processing units are configured to compress the image data captured by the camera sensors. A computing system is configured to store the compressed image data in a memory. The computing system is further configured with a vehicle-control processor configured to control the vehicle based on the compressed image data. The optical system and the computing system can be communicatively coupled by a data bus.
-
公开(公告)号:US20250080700A1
公开(公告)日:2025-03-06
申请号:US18948304
申请日:2024-11-14
Applicant: Waymo LLC
Inventor: Pierre-Yves Droz , Simon Verghes , Brendan Hermalyn
Abstract: Example implementations are provided for an arrangement of co-aligned rotating sensors. One example device includes a light detection and ranging (LIDAR) transmitter that emits light pulses toward a scene according to a pointing direction of the device. The device also includes a LIDAR receiver that detects reflections of the emitted light pulses reflecting from the scene. The device also includes an image sensor that captures an image of the scene based on at least external light originating from one or more external light sources. The device also includes a platform that supports the LIDAR transmitter, the LIDAR receiver, and the image sensor in a particular relative arrangement. The device also includes an actuator that rotates the platform about an axis to adjust the pointing direction of the device.
-
公开(公告)号:US12032097B2
公开(公告)日:2024-07-09
申请号:US18171883
申请日:2023-02-21
Applicant: Waymo LLC
Inventor: Caner Onal , David Schleuning , Brendan Hermalyn , Simon Verghese , Alex McCauley , Brandyn White , Ury Zhilinsky
IPC: G01S7/48 , G01S7/481 , G01S7/4865 , G01S17/931
CPC classification number: G01S7/4865 , G01S7/4804 , G01S7/4816 , G01S17/931
Abstract: The present disclosure relates to systems and methods that provide both an image of a scene and depth information for the scene. An example system includes at least one time-of-flight (ToF) sensor and an imaging sensor. The ToF sensor and the imaging sensor are configured to receive light from a scene. The system also includes at least one light source and a controller that carries out operations. The operations include causing the at least one light source to illuminate at least a portion of the scene with illumination light according to an illumination schedule. The operations also include causing the at least one ToF sensor to provide information indicative of a depth map of the scene based on the illumination light. The operations additionally include causing the imaging sensor to provide information indicative of an image of the scene based on the illumination light.
-
-
-
-
-
-
-
-
-