-
公开(公告)号:US11836955B2
公开(公告)日:2023-12-05
申请号:US17150228
申请日:2021-01-15
Applicant: Waymo LLC
Inventor: Zhinan Xu , Maya Kabkab , Chen Wu , Woojong Koh
CPC classification number: G06V10/7784 , G05D1/0088 , G05D1/0246 , G06T7/60 , G06T7/90 , G06V20/20 , G06V20/582 , G06T2207/30252
Abstract: Aspects of the disclosure relate to determining a sign type of an unfamiliar sign. The system may include one or more processors. The one or more processors may be configured to receive an image and identify image data corresponding to a traffic sign in the image. The image data corresponding to the traffic sign may be input in a sign type model. The processors may determine that the sign type model was unable to identify a type of the traffic sign and determine one or more attributes of the traffic sign. The one or more attributes of the traffic sign may be compared to known attributes of other traffic signs and based on this comparison, a sign type of the traffic sign may be determined. The vehicle may be controlled in an autonomous driving mode based on the sign type of the traffic sign.
-
公开(公告)号:US20220097731A1
公开(公告)日:2022-03-31
申请号:US17037017
申请日:2020-09-29
Applicant: Waymo LLC
Inventor: Zhinan Xu
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detecting foreign objects using a surfel map. One of the methods includes receiving sensor data representing reflection characteristics of electromagnetic waves in an operating environment of an autonomous vehicle. A surfel map representing a portion of the operating environment of the autonomous vehicle is used to determine that the reflection data includes one or more mismatched reflection characteristics for a particular surfel in the surfel map. In response, a foreign object is detected at a location corresponding to the particular surfel having the one or more mismatched reflection characteristics.
-
公开(公告)号:US20180032078A1
公开(公告)日:2018-02-01
申请号:US15292818
申请日:2016-10-13
Applicant: Waymo LLC
Inventor: David Ian Franklin Ferguson , Andreas Wendel , Zhinan Xu , David Harrison Silver , Brandon Douglas Luders
CPC classification number: G05D1/0214 , G05D1/0246 , G05D2201/0213 , G06K9/00805
Abstract: Aspects of the disclosure relate to maneuvering a vehicle. As an example, sensor information identifying a set of objects as well as a set of characteristics for each object of the set of objects is received from a perception system of a vehicle. The set of objects is filtered to remove objects corresponding to vehicles, bicycles, and pedestrians. An object within an expected future path of the vehicle is selected from the filtered set of objects. The object is classified as drivable or not drivable based on the set of characteristics. Drivable indicates that the vehicle can drive over the object without causing damage to the vehicle. The vehicle is maneuvered based on the classification such that when the object is classified as drivable, maneuvering the vehicle includes driving the vehicle over the object by not altering the expected future path of the vehicle.
-
公开(公告)号:US20230046289A1
公开(公告)日:2023-02-16
申请号:US17893376
申请日:2022-08-23
Applicant: WAYMO LLC
Inventor: Justin Thorsen , Changchang Wu , Alper Ayvaci , Tiffany Chen , Lo Po Tsui , Zhinan Xu , Chen Wu , Sean Rafferty
IPC: G06K19/067 , G09F3/00
Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data, for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.
-
公开(公告)号:US11475263B2
公开(公告)日:2022-10-18
申请号:US16827835
申请日:2020-03-24
Applicant: WAYMO LLC
Inventor: Justin Thorsen , Changchang Wu , Alper Ayvaci , Tiffany Chen , Lo Po Tsui , Zhinan Xu , Chen Wu , Sean Rafferty
IPC: G06K19/067 , G09F3/00
Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.
-
公开(公告)号:US10203696B2
公开(公告)日:2019-02-12
申请号:US15292818
申请日:2016-10-13
Applicant: Waymo LLC
Inventor: David Ian Franklin Ferguson , Andreas Wendel , Zhinan Xu , David Harrison Silver , Brandon Douglas Luders
Abstract: Aspects of the disclosure relate to maneuvering a vehicle. As an example, sensor information identifying a set of objects as well as a set of characteristics for each object of the set of objects is received from a perception system of a vehicle. The set of objects is filtered to remove objects corresponding to vehicles, bicycles, and pedestrians. An object within an expected future path of the vehicle is selected from the filtered set of objects. The object is classified as drivable or not drivable based on the set of characteristics. Drivable indicates that the vehicle can drive over the object without causing damage to the vehicle. The vehicle is maneuvered based on the classification such that when the object is classified as drivable, maneuvering the vehicle includes driving the vehicle over the object by not altering the expected future path of the vehicle.
-
公开(公告)号:US20250103844A1
公开(公告)日:2025-03-27
申请号:US18973983
申请日:2024-12-09
Applicant: Waymo LLC
Inventor: Justin Thorsen , Changchang Wu , Alper Ayvaci , Tiffany Chen , Lo Po Tsui , Zhinan Xu , Chen Wu , Sean Rafferty
IPC: G06K19/067 , G09F3/00
Abstract: Aspects of the disclosure provide for automatically generating labels for sensor data. For instance, first sensor data for a vehicle may be identified. This first sensor data may have been captured by a first sensor of the vehicle at a first location during a first point in time and may be associated with a first label for an object. Second sensor data for the vehicle may be identified. The second sensor data may have been captured by a second sensor of the vehicle at a second location at a second point in time outside of the first point in time. The second location is different from the first location. A determination may be made as to whether the object is a static object. Based on the determination that the object is a static object, the first label may be used to automatically generate a second label for the second sensor data.
-
公开(公告)号:US12020412B1
公开(公告)日:2024-06-25
申请号:US17644432
申请日:2021-12-15
Applicant: Waymo LLC
Inventor: Xiaoying He , Ryan Geiss , Pieter Kapsenberg , Carl Warren Craddock , Zhinan Xu , Lucian Ion , Ajay Chandra Venkata Gummalla
IPC: G06K9/00 , G06T3/4007 , G06T5/92 , G06T5/94
CPC classification number: G06T5/92 , G06T3/4007 , G06T5/94 , G06T2207/20084 , G06T2207/20208 , G06T2207/30252
Abstract: A system is provided that includes an image sensor coupled to a vehicle, and control circuitry configured to perform operations including receiving, from the image sensor, an input stream comprising high dynamic range (HDR) image data associated with an environment of the vehicle, and processing the input stream at the vehicle by applying a global tone mapping, followed by offline image processing that can include applying a local tone mapping to the globally tone mapped images of the same input stream.
-
公开(公告)号:US11989666B1
公开(公告)日:2024-05-21
申请号:US18187005
申请日:2023-03-21
Applicant: Waymo LLC
Inventor: Jens-Steffen Ralf Gutmann , Zhinan Xu
CPC classification number: G06N5/04 , G05D1/0088 , G06N20/00
Abstract: The technology relates to predicting that an object is going to enter into a trajectory of a vehicle. This may include receiving sensor data identifying a first location of the object in an environment of the vehicle at a first point in time and receiving sensor data identifying a second location of the object in the environment at a second point in time. In addition, a boundary of the trajectory is determined by defining at least a two-dimensional area through which the vehicle is expected to travel in the future. A first distance between the boundary and the first location and a second distance between the trajectory and the second location are determined. The first distance and the second distance are used to determine that the object is going to enter into the trajectory at a future point in time.
-
公开(公告)号:US20240320810A1
公开(公告)日:2024-09-26
申请号:US18678388
申请日:2024-05-30
Applicant: Waymo LLC
Inventor: Xiaoying He , Ryan Geiss , Pieter Kapsenberg , Carl Warren Craddock , Zhinan Xu , Lucian Ion , Ajay Chandra Venkata Gummalla
IPC: G06T5/92 , G06T3/4007 , G06T5/94
CPC classification number: G06T5/92 , G06T3/4007 , G06T5/94 , G06T2207/20084 , G06T2207/20208 , G06T2207/30252
Abstract: A system is provided that includes an image sensor coupled to a vehicle, and control circuitry configured to perform operations including receiving, from the image sensor, an input stream comprising high dynamic range (HDR) image data associated with an environment of the vehicle, and processing the input stream at the vehicle by applying a global tone mapping, followed by offline image processing that can include applying a local tone mapping to the globally tone mapped images of the same input stream.
-
-
-
-
-
-
-
-
-