-
公开(公告)号:US12217168B2
公开(公告)日:2025-02-04
申请号:US17099656
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Jiyang Gao , Yi Shen , Hang Zhao , Chen Sun
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using vectorized inputs.
-
公开(公告)号:US20230143433A1
公开(公告)日:2023-05-11
申请号:US17173818
申请日:2021-02-11
Applicant: Waymo LLC
IPC: G01S13/931 , G01S13/86 , G01S7/41 , B60W30/08 , G06T7/70
CPC classification number: G01S13/931 , G01S13/867 , G01S7/417 , B60W30/08 , G06T7/70 , B60W2420/52 , B60W2754/10 , B60W2554/00 , B60W2420/42 , G06T2207/10028 , G06T2207/30252 , G06T2207/10024 , G06T2207/20084
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20210150350A1
公开(公告)日:2021-05-20
申请号:US17099656
申请日:2020-11-16
Applicant: Waymo LLC
Inventor: Jiyang Gao , Yi Shen , Hang Zhao , Chen Sun
IPC: G06N3/08
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using vectorized inputs.
-
公开(公告)号:US11733369B2
公开(公告)日:2023-08-22
申请号:US17173818
申请日:2021-02-11
Applicant: Waymo LLC
CPC classification number: G01S13/867 , B60W30/08 , G01S7/417 , G01S13/86 , G01S13/89 , G01S13/931 , G06T7/70 , B60W2420/42 , B60W2420/52 , B60W2554/00 , B60W2754/10 , G01S2013/93271 , G06T2207/10024 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US12066525B2
公开(公告)日:2024-08-20
申请号:US18344433
申请日:2023-06-29
Applicant: Waymo LLC
CPC classification number: G01S13/867 , B60W30/08 , G01S7/417 , G01S13/86 , G01S13/89 , G01S13/931 , G06T7/70 , B60W2420/403 , B60W2420/408 , B60W2554/00 , B60W2754/10 , G01S2013/93271 , G06T2207/10024 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20240149906A1
公开(公告)日:2024-05-09
申请号:US17387852
申请日:2021-07-28
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/42 , B60W2554/4049
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting future trajectories for an agent in an environment. A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle in an. environment up to a current time point. The system identifies a plurality of initial target locations in the environment. The system further generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent starting from the current time point. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent that is a prediction of the future trajectory of the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent starting from the current time point, one or more of the predicted future trajectories.
-
公开(公告)号:US20220169244A1
公开(公告)日:2022-06-02
申请号:US17540140
申请日:2021-12-01
Applicant: Waymo LLC
Inventor: Pei Sun , Hang Zhao , Alexander McCauley , Benjamin Sapp , Jiyang Gao , Dragomir Anguelov , Xin Huang , Kyriacos Christoforos Shiarlis
IPC: B60W30/095 , B60W60/00 , B60W50/00 , B60W40/04 , G06N3/04
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for agent trajectory prediction using temporal-spatial interaction predictions.
-
公开(公告)号:US20240278803A1
公开(公告)日:2024-08-22
申请号:US18423136
申请日:2024-01-25
Applicant: Waymo LLC
Inventor: Hang Zhao , Jiyang Gao , Chen Sun , Yi Shen , Yuning Chai , Cordelia Luise Schmid , Congcong Li , Benjamin Sapp , Dragomir Anguelov , Tian Lan , Yue Shen
CPC classification number: B60W60/001 , G06N3/02 , B60W2420/403 , B60W2554/4049
Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for predicting future trajectories for an agent in an environment. A system obtains scene context data characterizing the environment. The scene context data includes data that characterizes a trajectory of an agent in a vicinity of a vehicle in an environment up to a current time point. The system identifies a plurality of initial target locations in the environment. The system further generates, for each of a plurality of target locations that each corresponds to one of the initial target locations, a respective predicted likelihood score that represents a likelihood that the target location will be an intended final location for a future trajectory of the agent starting from the current time point. For each target location in a first subset of the target locations, the system generates a predicted future trajectory for the agent that is a prediction of the future trajectory of the agent given that the target location is the intended final location for the future trajectory. The system further selects, as likely future trajectories of the agent starting from the current time point, one or more of the predicted future trajectories.
-
公开(公告)号:US20230350051A1
公开(公告)日:2023-11-02
申请号:US18344433
申请日:2023-06-29
Applicant: Waymo LLC
CPC classification number: G01S13/867 , G06T7/70 , B60W30/08 , G01S7/417 , G01S13/86 , G01S13/89 , G01S13/931 , G01S2013/93271 , B60W2554/00 , B60W2754/10 , B60W2420/42 , B60W2420/52 , G06T2207/10024 , G06T2207/10028 , G06T2207/20084 , G06T2207/30252
Abstract: Example embodiments relate to techniques for three dimensional (3D) object detection and localization. A computing system may cause a radar unit to transmit radar signals and receive radar reflections relative to an environment of a vehicle. Based on the radar reflections, the computing system may determine a heading and a range for a nearby object. The computing system may also receive an image depicting a portion of the environment that includes the object from a vehicle camera and remove peripheral areas of the image to generate an image patch that focuses upon the object based on the heading and the range for the object. The image patch and the heading and the range for the object can be provided as inputs into a neural network that provides output parameters corresponding to the object, which can be used to control the vehicle.
-
公开(公告)号:US20220180549A1
公开(公告)日:2022-06-09
申请号:US17545987
申请日:2021-12-08
Applicant: Waymo LLC
Inventor: Longlong Jing , Ruichi Yu , Jiyang Gao , Henrik Kretzschmar , Kang Li , Ruizhongtai Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Congcong Li
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting three-dimensional object locations from images. One of the methods includes obtaining a sequence of images that comprises, at each of a plurality of time steps, a respective image that was captured by a camera at the time step; generating, for each image in the sequence, respective pseudo-lidar features of a respective pseudo-lidar representation of a region in the image that has been determined to depict a first object; generating, for a particular image at a particular time step in the sequence, image patch features of the region in the particular image that has been determined to depict the first object; and generating, from the respective pseudo-lidar features and the image patch features, a prediction that characterizes a location of the first object in a three-dimensional coordinate system at the particular time step in the sequence.
-
-
-
-
-
-
-
-
-