-
公开(公告)号:US20230147270A1
公开(公告)日:2023-05-11
申请号:US18150249
申请日:2023-01-05
Applicant: Waymo LLC
Inventor: Blaise Gassend , Benjamin Ingram , Andreas Wendel , Mark Alexander Shand
IPC: H04N25/531 , G06T7/521 , G01S17/89 , G01S17/42 , G01S17/86 , H04N23/45 , H04N23/71 , H04N23/73 , H04N23/90 , H04N23/698 , H04N25/40
CPC classification number: H04N25/531 , G06T7/521 , G01S17/89 , G01S17/42 , G01S17/86 , H04N23/45 , H04N23/71 , H04N23/73 , H04N23/90 , H04N23/698 , H04N25/40 , G06T2207/10152 , G06T2207/10028 , G06T17/05
Abstract: One example system comprises a LIDAR sensor that rotates about an axis to scan an environment of the LIDAR sensor. The system also comprises one or more cameras that detect external light originating from one or more external light sources. The one or more cameras together provide a plurality of rows of sensing elements. The rows of sensing elements are aligned with the axis of rotation of the LIDAR sensor. The system also comprises a controller that operates the one or more cameras to obtain a sequence of image pixel rows. A first image pixel row in the sequence is indicative of external light detected by a first row of sensing elements during a first exposure time period. A second image pixel row in the sequence is indicative of external light detected by a second row of sensing elements during a second exposure time period.
-
公开(公告)号:US11619949B2
公开(公告)日:2023-04-04
申请号:US17068995
申请日:2020-10-13
Applicant: Waymo LLC
Abstract: Aspects of the disclosure relate to determining and responding to an internal state of a self-driving vehicle. For instance, an image of an interior of the vehicle captured by a camera mounted in the vehicle is received. The image is processed in order to identify one or more visible markers at predetermined locations within the vehicle. The internal state of the vehicle is determined based on the identified one or more visible markers. A responsive action is identified action using the determined internal state, and the vehicle is controlled in order to perform the responsive action.
-
公开(公告)号:US11561282B2
公开(公告)日:2023-01-24
申请号:US17503571
申请日:2021-10-18
Applicant: Waymo LLC
Inventor: Kimberly Geneva Toth , Brendan Hermalyn , Shane Mcguire , Felix Jose Alvarez Rivera , Jeremy Dittmer , Andreas Wendel
Abstract: The technology relates to autonomous vehicles that use a perception system to detect objects and features in the vehicle's surroundings. A camera assembly having a ring-type structure is provided that gives the perception system an overall 360° field of view around the vehicle. Image sensors are arranged in camera modules around the assembly to provide a seamless panoramic field of view. One subsystem has multiple pairs of image sensors positioned to provide the overall 360° field of view, while another subsystem provides a set of image sensors generally facing toward the front of the vehicle to provide enhanced object identification. The camera assembly may be arranged in a housing located on top of the vehicle. The housing may include other sensors such as LIDAR and radar. The assembly includes a chassis and top and base plates, which may provide EMI protection from other sensors disposed in the housing.
-
84.
公开(公告)号:US20220254048A1
公开(公告)日:2022-08-11
申请号:US17729483
申请日:2022-04-26
Applicant: Waymo LLC
Inventor: Andreas Wendel , Benjamin Ingram
IPC: G06T7/593 , G06V10/147 , G06V10/20 , G06V20/58 , B60W30/095 , G05D1/02
Abstract: The technology relates to camera systems for vehicles having an autonomous driving mode. An example system includes a first camera mounted on a vehicle in order to capture images of the vehicle's environment. The first camera has a first exposure time and being without an ND filter. The system also includes a second camera mounted on the vehicle in order to capture images of the vehicle's environment and having an ND filter. The system also includes one or more processors configured to capture images using the first camera and the first exposure time, capture images using the second camera and the second exposure time, use the images captured using the second camera to identify illuminated objects, use the images captured using the first camera to identify the locations of objects, and use the identified illuminated objects and identified locations of objects to control the vehicle in an autonomous driving mode.
-
公开(公告)号:US11196916B2
公开(公告)日:2021-12-07
申请号:US16935931
申请日:2020-07-22
Applicant: Waymo LLC
Inventor: Andreas Wendel , Jeremy Dittmer , Brendan Hermalyn , Benjamin Ingram
Abstract: Example embodiments relate to multiple operating modes to expand dynamic range. An example embodiment includes a camera system. The camera system may include a first image sensor having a first dynamic range corresponding to a first range of luminance levels in a scene. The system may also include a second image sensor having a second dynamic range corresponding to a second range of luminance levels in the scene. The camera system may further include a processor coupled to the first image sensor and the second image sensor. The processor may be configured to execute instructions to identify objects of a first type in a first image of the scene captured by the first image sensor and identify objects of a second object type in a second image of the scene captured by the second image sensor.
-
公开(公告)号:US20210203864A1
公开(公告)日:2021-07-01
申请号:US17186121
申请日:2021-02-26
Applicant: Waymo LLC
Inventor: Blaise Gassend , Benjamin Ingram , Andreas Wendel , Mark Alexander Shand
IPC: H04N5/353 , G06T7/521 , H04N5/235 , H04N5/247 , H04N5/341 , G01S17/89 , H04N5/225 , H04N5/232 , G01S17/42 , G01S17/86
Abstract: One example system comprises a LIDAR sensor that rotates about an axis to scan an environment of the LIDAR sensor. The system also comprises one or more cameras that detect external light originating from one or more external light sources. The one or more cameras together provide a plurality of rows of sensing elements. The rows of sensing elements are aligned with the axis of rotation of the LIDAR sensor. The system also comprises a controller that operates the one or more cameras to obtain a sequence of image pixel rows. A first image pixel row in the sequence is indicative of external light detected by a first row of sensing elements during a first exposure time period. A second image pixel row in the sequence is indicative of external light detected by a second row of sensing elements during a second exposure time period.
-
公开(公告)号:US20210034067A1
公开(公告)日:2021-02-04
申请号:US17068995
申请日:2020-10-13
Applicant: Waymo LLC
Abstract: Aspects of the disclosure relate to determining and responding to an internal state of a self-driving vehicle. For instance, an image of an interior of the vehicle captured by a camera mounted in the vehicle is received. The image is processed in order to identify one or more visible markers at predetermined locations within the vehicle. The internal state of the vehicle is determined based on the identified one or more visible markers. A responsive action is identified action using the determined internal state, and the vehicle is controlled in order to perform the responsive action.
-
88.
公开(公告)号:US10776938B2
公开(公告)日:2020-09-15
申请号:US16567221
申请日:2019-09-11
Applicant: Waymo LLC
Inventor: Andreas Wendel , Benjamin Ingram
Abstract: The technology relates to camera systems for vehicles having an autonomous driving mode. An example system includes a first camera mounted on a vehicle in order to capture images of the vehicle's environment. The first camera has a first exposure time and being without an ND filter. The system also includes a second camera mounted on the vehicle in order to capture images of the vehicle's environment and having an ND filter. The system also includes one or more processors configured to capture images using the first camera and the first exposure time, capture images using the second camera and the second exposure time, use the images captured using the second camera to identify illuminated objects, use the images captured using the first camera to identify the locations of objects, and use the identified illuminated objects and identified locations of objects to control the vehicle in an autonomous driving mode.
-
公开(公告)号:US20190351897A1
公开(公告)日:2019-11-21
申请号:US16448230
申请日:2019-06-21
Applicant: WAYMO LLC
Inventor: Jens-Steffen Ralf Gutmann , Andreas Wendel , Nathaniel Fairfield , Dmitri A. Dolgov , Donald Jason Burnette
IPC: B60W30/09 , G08G1/0962 , G08G1/0967 , B60W30/18
Abstract: Aspects of the disclosure relate to determining whether a vehicle should continue through an intersection. For example, the one or more of the vehicle's computers may identify a time when the traffic signal light will turn from yellow to red. The one or more computers may also estimate a location of a vehicle at the time when the traffic signal light will turn from yellow to red. A starting point of the intersection may be identified. Based on whether the estimated location of the vehicle is at least a threshold distance past the starting point at the time when the traffic signal light will turn from yellow to red, the computers can determine whether the vehicle should continue through the intersection.
-
公开(公告)号:US10346696B1
公开(公告)日:2019-07-09
申请号:US16137659
申请日:2018-09-21
Applicant: Waymo LLC
Inventor: Andreas Wendel , David Ian Franklin Ferguson
Abstract: The present disclosure is directed to an autonomous vehicle having a vehicle control system. The vehicle control system includes an image processing system. The image processing system receives an image that includes a plurality of image portions. The image processing system also calculates a score for each image portion. The score indicates a level of confidence that a given image portion represents an illuminated component of a traffic light. The image processing system further identifies one or more candidate portions from among the plurality of image portions. Additionally, the image processing system determines that a particular candidate portion represents an illuminated component of a traffic light using a classifier. Further, the image processing system provides instructions to control the autonomous vehicle based on the particular candidate portion representing an illuminated component of a traffic light.
-
-
-
-
-
-
-
-
-