-
公开(公告)号:US11688082B2
公开(公告)日:2023-06-27
申请号:US16692960
申请日:2019-11-22
申请人: Baidu USA LLC
发明人: Runxin He , Shiyu Song , Li Yu , Wendong Ding , Pengfei Yuan
IPC分类号: G06T7/33 , G06T7/73 , G01S17/42 , G01S17/931 , G01S7/48
CPC分类号: G06T7/33 , G01S7/4808 , G01S17/42 , G01S17/931 , G06T7/73 , G06T2207/10028 , G06T2207/20072 , G06T2207/20221 , G06T2207/30252
摘要: In one embodiment, a system and method for partitioning a region for point cloud registration of LIDAR poses of an autonomous driving vehicle (ADV) using a regional iterative closest point (ICP) algorithm is disclosed. The method determines the frame pair size of one or more pairs of related LIDAR poses of a region of an HD map to be constructed. If the frame pair size is greater than a threshold, the region is further divided into multiple clusters. The method may perform the ICP algorithm for each cluster. Inside a cluster, the ICP algorithm focuses on a partial subset of the decision variables and assumes the rest of the decision variables are fixed. To construct the HD map, the method may determine if the results of the ICP algorithms from the clusters converge. If the solutions converge, a solution to the point cloud registration for the region is found.
-
2.
公开(公告)号:US11493926B2
公开(公告)日:2022-11-08
申请号:US16413339
申请日:2019-05-15
申请人: Baidu USA LLC
发明人: Runxin He , Jinyun Zhou , Qi Luo , Shiyu Song , Jinghao Miao , Jiangtao Hu , Yu Wang , Jiaxuan Xu , Shu Jiang
摘要: In one embodiment, a system generates a plurality of driving scenarios to train a reinforcement learning (RL) agent and replays each of the driving scenarios to train the RL agent by: applying a RL algorithm to an initial state of a driving scenario to determine a number of control actions from a number of discretized control/action options for the ADV to advance to a number of trajectory states which are based on a number of discretized trajectory state options, determining a reward prediction by the RL algorithm for each of the controls/actions, determining a judgment score for the trajectory states, and updating the RL agent based on the judgment score.
-
公开(公告)号:US11468690B2
公开(公告)日:2022-10-11
申请号:US16336877
申请日:2019-01-30
发明人: Pengfei Yuan , Yong Xiao , Runxin He , Li Yu , Shiyu Song
IPC分类号: B60W40/06 , B60W60/00 , G01C21/00 , G01S17/42 , G01S17/89 , G01S7/48 , G06K9/62 , G06T17/05 , G06T5/00 , G06T7/11 , G06V10/30 , G06V10/44 , G06V20/56
摘要: In one embodiment, a system identifies a road to be navigated by an ADV, the road being captured by one or more point clouds from one or more LIDAR sensors. The system extracts road marking information of the identified road from the point clouds, the road marking information describing one or more road markings of the identified road. The system partitions the road into one or more road partitions based on the road markings. The system generates a point cloud map based on the road partitions, where the point cloud map is utilized to perceive a driving environment surrounding the ADV.
-
公开(公告)号:US11338819B2
公开(公告)日:2022-05-24
申请号:US16588586
申请日:2019-09-30
发明人: Shu Jiang , Qi Luo , Jinghao Miao , Jiangtao Hu , Xiangquan Xiao , Jiaxuan Xu , Yu Wang , Jinyun Zhou , Runxin He
IPC分类号: B60W50/04 , G06N20/00 , B60W10/04 , B60W10/18 , B60W10/20 , B60W30/18 , G05D1/00 , G06N5/04 , B60W50/00
摘要: In one embodiment, a computer-implemented method for calibrating autonomous driving vehicles at a cloud-based server includes receiving, at the cloud-based server, one or more vehicle calibration requests from at least one user, each vehicle calibration request including calibration data for one or more vehicles and processing in parallel, by the cloud-based server, the one or more vehicle calibration requests for the at least one user to generate a calibration result for each vehicle. The method further includes sending, by the cloud-based server, the calibration result for each vehicle to the at least one user.
-
公开(公告)号:US11465642B2
公开(公告)日:2022-10-11
申请号:US16336867
申请日:2019-01-30
发明人: Yong Xiao , Runxin He , Pengfei Yuan , Li Yu , Shiyu Song
摘要: In one embodiment, a system receives a stream of frames of point clouds from one or more LIDAR sensors of an ADV and corresponding poses in real-time. The system extracts segment information for each frame of the stream based on geometric or spatial attributes of points in the frame, where the segment information includes one or more segments of at least a first frame corresponding to a first pose. The system registers the stream of frames based on the segment information. The system generates a first point cloud map for the stream of frames based on the frame registration.
-
公开(公告)号:US11409284B2
公开(公告)日:2022-08-09
申请号:US16413315
申请日:2019-05-15
申请人: Baidu USA LLC
发明人: Runxin He , Jinyun Zhou , Qi Luo , Shiyu Song , Jinghao Miao , Jiangtao Hu , Yu Wang , Jiaxuan Xu , Shu Jiang
IPC分类号: G01C22/00 , G05D1/00 , G05D1/02 , G06F16/9537
摘要: In one embodiment, an open space model is generated for a system to plan trajectories for an ADV in an open space. The system perceives an environment surrounding an ADV including one or more obstacles. The system determines a target function for the open space model based on constraints for the one or more obstacles and map information. The system iteratively, performs a first quadratic programming (QP) optimization on the target function based on a first trajectory while fixing a first set of variables, and performs a second QP optimization on the target function based on a result of the first QP optimization while fixing a second set of variables. The system generates a second trajectory based on results of the first and the second QP optimizations to control the ADV autonomously according to the second trajectory.
-
公开(公告)号:US11269329B2
公开(公告)日:2022-03-08
申请号:US16659040
申请日:2019-10-21
申请人: Baidu USA LLC
发明人: Shu Jiang , Qi Luo , Jinghao Miao , Jiangtao Hu , Jiaxuan Xu , Jingao Wang , Yu Wang , Jinyun Zhou , Runxin He
摘要: In one embodiment, a set of parameters representing a first state of an autonomous driving vehicle (ADV) to be simulated and a set of control commands to be issued at a first point in time. In response, a localization predictive model is applied to the set of parameters to determine a first position (e.g., x, y) of the ADV. A localization correction model is applied to the set of parameters to determine a set of localization correction factors (e.g., Δx, Δy). The correction factors may represent the errors between the predicted position of the ADV by the localization predictive model and the ground truth measured by sensors of the vehicle. Based on the first position of the ADV and the correction factors, a second position of the ADV is determined as the simulated position of the ADV.
-
公开(公告)号:US20210334988A1
公开(公告)日:2021-10-28
申请号:US16336872
申请日:2019-01-30
发明人: Yong Xiao , Runxin He , Pengfei Yuan , Li Yu , Shiyu Song
摘要: In one embodiment, a system receives a number of point clouds captured by one or more LIDAR sensors of an ADV and corresponding poses. The system receives a number of RGB images from one or more image capturing sensors of the ADV. The system synchronizes the RGB images with the point clouds to obtain RGB point clouds. The system extracts features from the RGB point clouds, the features including contextual and spatial information of the RGB point clouds. The system registers the RGB point clouds based on the extracted features and generates a point cloud map based on the registration of the RGB point clouds.
-
公开(公告)号:US11608078B2
公开(公告)日:2023-03-21
申请号:US16336858
申请日:2019-01-30
发明人: Runxin He , Yong Xiao , Pengfei Yuan , Li Yu , Shiyu Song
摘要: In one embodiment, a system is disclosed for registration of point clouds for autonomous driving vehicles (ADV). The system receives a number of point clouds and corresponding poses from ADVs equipped with LIDAR sensors capturing point clouds of a navigable area to be mapped, where the point clouds correspond to a first coordinate system. The system partitions the point clouds and the corresponding poses into one or more loop partitions based on navigable loop information captured by the point clouds. For each of the loop partitions, the system applies an optimization model to point clouds corresponding to the loop partition to register the point clouds. They system merges the one or more loop partitions together using a pose graph algorithm, where the merged partitions of point clouds are utilized to perceive a driving environment surrounding the ADV.
-
10.
公开(公告)号:US11521329B2
公开(公告)日:2022-12-06
申请号:US16692956
申请日:2019-11-22
申请人: Baidu USA LLC
发明人: Runxin He , Shiyu Song , Li Yu , Wendong Ding , Pengfei Yuan
摘要: In one embodiment, a system and method for point cloud registration of LIDAR poses of an autonomous driving vehicle (ADV) is disclosed. The method selects poses of the point clouds that possess higher confidence level during the data capture phase as fixed anchor poses. The fixed anchor points are used to estimate and optimize the poses of non-anchor poses during point cloud registration. The method may partition the points clouds into blocks to perform the ICP algorithm for each block in parallel by minimizing the cost function of the bundle adjustment equation updated with a regularity term. The regularity term may measure the difference between current estimates of the poses and previous or the initial estimates. The method may also minimize the bundle adjustment equation updated with a regularity term when solving the pose graph problem to merge the optimized poses from the blocks to make connections between the blocks.
-
-
-
-
-
-
-
-
-