-
公开(公告)号:US20220156965A1
公开(公告)日:2022-05-19
申请号:US17505900
申请日:2021-10-20
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US20250037303A1
公开(公告)日:2025-01-30
申请号:US18614254
申请日:2024-03-22
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
IPC: G06T7/73 , G06F18/214 , G06F18/25 , G06V20/58
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US11361187B1
公开(公告)日:2022-06-14
申请号:US17118989
申请日:2020-12-11
Applicant: Waymo LLC
Inventor: Junhua Mao , Congcong Li , Yang Song
Abstract: Aspects of the subject matter disclosed herein include methods, systems, and other techniques for training, in a first phase, an object classifier neural network with a first set of training data, the first set of training data including a first plurality of training examples, each training example in the first set of training data being labeled with a coarse-object classification; and training, in a second phase after completion of the first phase, the object classifier neural network with a second set of training data, the second set of training data including a second plurality of training examples, each training example in the second set of training data being labeled with a fine-object classification.
-
公开(公告)号:US11967103B2
公开(公告)日:2024-04-23
申请号:US17505900
申请日:2021-10-20
Applicant: Waymo LLC
Inventor: Jingxiao Zheng , Xinwei Shi , Alexander Gorban , Junhua Mao , Andre Liang Cornman , Yang Song , Ting Liu , Ruizhongtai Qi , Yin Zhou , Congcong Li , Dragomir Anguelov
IPC: G06T7/73 , G06F18/214 , G06F18/25 , G06V20/58
CPC classification number: G06T7/73 , G06F18/214 , G06F18/251 , G06V20/58 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2207/30261
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for estimating a 3-D pose of an object of interest from image and point cloud data. In one aspect, a method includes obtaining an image of an environment; obtaining a point cloud of a three-dimensional region of the environment; generating a fused representation of the image and the point cloud; and processing the fused representation using a pose estimation neural network and in accordance with current values of a plurality of pose estimation network parameters to generate a pose estimation network output that specifies, for each of multiple keypoints, a respective estimated position in the three-dimensional region of the environment.
-
公开(公告)号:US11842282B2
公开(公告)日:2023-12-12
申请号:US17836287
申请日:2022-06-09
Applicant: Waymo LLC
Inventor: Junhua Mao , Congcong Li , Yang Song
IPC: G06V20/56 , G06N3/084 , G05D1/02 , G06N3/08 , G06F18/20 , G06F18/25 , G06F18/21 , G06F18/214 , G06F18/2431 , G06N3/044 , G06V30/19 , G06V30/24 , G06V10/764 , G06V10/80 , G06V10/82 , G06V20/58
CPC classification number: G06N3/084 , G05D1/0221 , G05D1/0231 , G06F18/217 , G06F18/2148 , G06F18/2431 , G06F18/25 , G06F18/285 , G06N3/044 , G06N3/08 , G06V10/764 , G06V10/809 , G06V10/82 , G06V20/56 , G06V20/58 , G06V30/19173 , G06V30/2504
Abstract: Aspects of the subject matter disclosed herein include methods, systems, and other techniques for training, in a first phase, an object classifier neural network with a first set of training data, the first set of training data including a first plurality of training examples, each training example in the first set of training data being labeled with a coarse-object classification; and training, in a second phase after completion of the first phase, the object classifier neural network with a second set of training data, the second set of training data including a second plurality of training examples, each training example in the second set of training data being labeled with a fine-object classification.
-
公开(公告)号:US20230072020A1
公开(公告)日:2023-03-09
申请号:US17940665
申请日:2022-09-08
Applicant: Waymo LLC
Inventor: Andre Liang Cornman , David Lee , Yang Song , Zijian Guo , Edward Stephen Walker, Jr. , Yuanfang Wang , Zhengli Zhao , Hsu-kuang Chiu
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for open vehicle doors prediction using a neural network model. One of the methods includes: obtaining sensor data (i) that includes a portion of a point cloud generated by a laser sensor of an autonomous vehicle and (ii) that characterizes a vehicle that is in a vicinity of the autonomous vehicle in an environment; and processing the sensor data using an open door prediction neural network to generate an open door prediction that predicts a likelihood score that the vehicle has an open door.
-
公开(公告)号:US20220374650A1
公开(公告)日:2022-11-24
申请号:US17836287
申请日:2022-06-09
Applicant: Waymo LLC
Inventor: Junhua Mao , Congcong Li , Yang Song
Abstract: Aspects of the subject matter disclosed herein include methods, systems, and other techniques for training, in a first phase, an object classifier neural network with a first set of training data, the first set of training data including a first plurality of training examples, each training example in the first set of training data being labeled with a coarse-object classification; and training, in a second phase after completion of the first phase, the object classifier neural network with a second set of training data, the second set of training data including a second plurality of training examples, each training example in the second set of training data being labeled with a fine-object classification.
-
公开(公告)号:US20210284184A1
公开(公告)日:2021-09-16
申请号:US17194072
申请日:2021-03-05
Applicant: Waymo LLC
Inventor: Yang Song , Shuyang Cheng , Zijian Guo , Congcong Li , Chunyan Bai
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining a point cloud augmentation policy and training a machine learning model using the point cloud augmentation policy to perform a perception task such as object detection or classification task by processing point cloud data. In general, training a machine learning model using the determined point cloud augmentation policy enables the model to more effectively perform the perception task, i.e., by generating higher quality perception outputs. When deployed within an on-board system of a vehicle, the machine learning model can further enable the on-board system to generate better-informed planning decisions which in turn result in a safer journey, even when the vehicle is navigating through unconventional environments or inclement weathers such as rain or snow.
-
公开(公告)号:US20220366263A1
公开(公告)日:2022-11-17
申请号:US17313655
申请日:2021-05-06
Applicant: Waymo LLC
Inventor: Ming Ji , Edward Stephen Walker, JR. , Yang Song , Zijian Guo , Congcong Li
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training a student machine learning model using a teacher machine learning model that has a pre-trained feature extractor. In one aspect, a method includes obtaining data specifying the teacher machine learning model that is configured to perform a machine learning task; obtaining first training data; training the teacher machine learning model on the first training data to obtain a trained teacher machine learning model; generating second, automatically labeled training data by using the trained teacher machine learning model to process unlabeled training data; and training a student machine learning model to perform the machine learning task using at least the second, automatically labeled training data, wherein the student machine learning model does not include the pre-trained feature extractor and instead includes a different feature extractor having fewer parameters than the pre-trained feature extractor.
-
-
-
-
-
-
-
-