-
公开(公告)号:US20230334776A1
公开(公告)日:2023-10-19
申请号:US18338864
申请日:2023-06-21
Applicant: Waymo LLC
Inventor: Christian Lauterbach , Colin Andrew Braley , Carlos Hernandez Esteban , Michael Montemerlo
IPC: G06T17/00 , G01C21/36 , G06V20/20 , G06V20/56 , G01S17/89 , G06T17/05 , G06T17/20 , G01S17/88 , G06T15/20 , G06V20/58 , G06V10/44 , G06F18/24 , G06F18/2113
CPC classification number: G06T17/00 , G01C21/3667 , G06V20/20 , G06V20/56 , G01S17/89 , G06T17/05 , G06T17/20 , G01S17/88 , G06T15/205 , G06V20/58 , G06V10/44 , G06F18/24 , G06F18/2113 , G06T2207/10028 , G06T2210/56
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for sensor calibration with environment map. In some implementations, a three-dimensional surfel representation of a real-world environment is obtained. One or more surfels of the surfel representation having a particular classification of the different classifications are selected. Input sensor data from one or more sensors installed on an autonomous or semi-autonomous vehicle are received. The input sensor data is compared to the surfel representation to identify one or more differences between the observation and the surfel representation. At least one sensor of the one or more sensors is calibrated using the one or more differences between the observation and the surfel representation.
-
公开(公告)号:US20230076479A1
公开(公告)日:2023-03-09
申请号:US17819883
申请日:2022-08-15
Applicant: Waymo LLC
Inventor: Dragomir Anguelov , Colin Andrew Braley , Christoph Sprunk
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for the generation and use of a surfel map with semantic labels. One of the methods includes receiving a surfel map that includes a plurality of surfels, wherein each surfel has associated data that includes one or more semantic labels; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more surfels corresponding to the one or more locations of the obtained sensor data; identifying one or more semantic labels for the one or more surfels corresponding to the one or more locations of the obtained sensor data; and performing, for each surfel corresponding to the one or more locations of the obtained sensor data, a label-specific detection process for the surfel.
-
公开(公告)号:US20220146676A1
公开(公告)日:2022-05-12
申请号:US16949657
申请日:2020-11-09
Applicant: Waymo LLC
Inventor: Nicholas Armstrong-Crews , Mingcheng Chen , Xiaoxiang Hu , Colin Andrew Braley , Yunshan Jiang
Abstract: Aspects and implementations of the present disclosure address shortcomings of the existing technology by enabling efficient object identification and tracking in autonomous vehicle (AV) applications by using velocity data-assisted mapping of first set of points obtained for a first sensing data frame by a sensing system of the AV to a second set of points obtained for a second sensing data frame by the sensing system of the AV, the first set of points and the second set of points corresponding to an object in an environment of the AV, and causing a driving path of the AV to be determined in view of the performed mapping.
-
公开(公告)号:US11961272B2
公开(公告)日:2024-04-16
申请号:US18201546
申请日:2023-05-24
Applicant: Waymo LLC
Inventor: David Yonchar Margines , Carlos Hernandez Esteban , Michael Montemerlo , Peter Pawlowski , Colin Andrew Braley
CPC classification number: G06V10/25 , B60W60/001 , G06T7/90 , G06V10/751 , G06V20/58 , B60W2420/42 , B60W2420/52 , B60W2554/802 , G06T2207/30261
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using a surfel map to generate long range localization. One of the methods includes obtaining, for a particular location of a vehicle having a camera and a detection sensor, surfel data including a plurality of surfels. Each surfel in the surfel data has a respective location and corresponds to a different respective detected surface in an environment. Image data captured by the camera is obtained. It is determined that a region of interest for detecting objects for a vehicle planning process is outside a detectable region for the detection sensor. In response, it is determined that the image data for the region of interest matches surfel color data for the surfels corresponding to the region of interest. In response, the vehicle planning process is performed with the region of interest designated as having no unexpected objects.
-
公开(公告)号:US11473931B2
公开(公告)日:2022-10-18
申请号:US17021811
申请日:2020-09-15
Applicant: Waymo LLC
Inventor: Michael Montemerlo , Colin Andrew Braley
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing an initial representation of an environment to generate an updated representation that includes representations of one or more objects there were obscured in the initial representation. One of the methods includes obtaining initial surfel data comprising a plurality of surfels; determining a plurality of non-static surfels from the plurality of surfels; obtaining guidance data that characterizes a prediction for static surfaces in one or more first regions of the environment that were obscured by the plurality of non-static surfels in the initial surfel data; and processing the guidance data and the initial surfel data to generate final surfel data that comprises, for each first region of the environment, a plurality of predicted surfels that represent static surfaces in the first region that are partially or wholly obscured by objects represented by respective non-static surfels.
-
公开(公告)号:US11417110B2
公开(公告)日:2022-08-16
申请号:US17015809
申请日:2020-09-09
Applicant: Waymo LLC
Inventor: Dragomir Anguelov , Colin Andrew Braley , Christoph Sprunk
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for the generation and use of a surfel map with semantic labels. One of the methods includes receiving a surfel map that includes a plurality of surfels, wherein each surfel has associated data that includes one or more semantic labels; obtaining sensor data for one or more locations in the environment, the sensor data having been captured by one or more sensors of a first vehicle; determining one or more surfels corresponding to the one or more locations of the obtained sensor data; identifying one or more semantic labels for the one or more surfels corresponding to the one or more locations of the obtained sensor data; and performing, for each surfel corresponding to the one or more locations of the obtained sensor data, a label-specific detection process for the surfel.
-
公开(公告)号:US20220204019A1
公开(公告)日:2022-06-30
申请号:US17139557
申请日:2020-12-31
Applicant: Waymo LLC
Inventor: Christian Lauterbach , Colin Andrew Braley , Carlos Hernandez Esteban , Michael Montemerlo
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for sensor calibration with environment map. In some implementations, a three-dimensional surfel representation of a real-world environment is obtained. One or more surfels of the surfel representation having a particular classification of the different classifications are selected. Input sensor data from one or more sensors installed on an autonomous or semi-autonomous vehicle are received. The input sensor data is compared to the surfel representation to identify one or more differences between the observation and the surfel representation. At least one sensor of the one or more sensors is calibrated using the one or more differences between the observation and the surfel representation.
-
公开(公告)号:US20220097726A1
公开(公告)日:2022-03-31
申请号:US17036926
申请日:2020-09-29
Applicant: Waymo LLC
Inventor: Michael Buchanan , Aleksandar Rumenov Gabrovski , Colin Andrew Braley , David Yonchar Margines
IPC: B60W60/00 , G05D1/02 , B60W30/095 , B60W30/18 , G06K9/00
Abstract: Methods, systems, and apparatus for generation and use of surfel maps to plan for occlusions. One of the methods includes receiving a previously-generated surfel map depicting an area in which a vehicle is located, the surfel map comprising a plurality of surfels, each surfel corresponding to a respective different location in the area in which a vehicle is located; receiving, from one or more sensors, sensor data representing the area in which the vehicle is located; determining, based on the sensor data, that the area in which a vehicle is located includes a dynamic object having a changed shape relative to its representation in the surfel map; and generating an updated path for the vehicle to travel that avoids an occlusion by the changed shape of the dynamic object of a line of sight of one or more sensors to an area of interest.
-
公开(公告)号:US20210003682A1
公开(公告)日:2021-01-07
申请号:US16460696
申请日:2019-07-02
Applicant: Waymo LLC
Inventor: Colin Andrew Braley
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining that prediction outputs generated by a prediction system are sensitive to variations in the values of one or more of a set of target sensor calibration parameters. In one aspect, a sensitivity analysis system is configured to perform operations comprising updating the values of one or more target sensor calibration parameters of each sensor data tuple of a plurality sensor data tuples, comprising, for each sensor data tuple: providing the sensor data tuple with the current values of the target sensor calibration parameters to the prediction subsystem to generate a current prediction output; determining a gradient of a function of the current prediction output with respect to the target sensor calibration parameters; and updating the current values of the target sensor calibration parameters of the sensor data tuple using the gradient.
-
公开(公告)号:US12174324B2
公开(公告)日:2024-12-24
申请号:US17115705
申请日:2020-12-08
Applicant: Waymo LLC
Inventor: Colin Andrew Braley , Antonio Teran Espinoza
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for using naturally collected data in sensor calibration. One of the methods includes obtaining, using a first, calibrated sensor, a first plurality of raw sensor measurements of an environment; determining, from the first plurality of raw sensor measurements, a Truncated Signed Distance Field (TSDF)-based model of surfaces in the environment; obtaining, using a second sensor, a second plurality of raw sensor measurements of the environment; determining a multi-dimensional point cloud representation of the environment; and determining refined values of the set of calibration parameters of the second sensor based on a difference between, for each data point, (i) the multiple values that define the data point and (ii) multiple values that define a target data point derived from the TSDF-based model of surfaces in the environment.
-
-
-
-
-
-
-
-
-