公开(公告)号：US20230194286A1

公开(公告)日：2023-06-22

申请号：US17558018

申请日：2021-12-21

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: G01C21/34 ,  G01C21/36 ,  H04W4/40

CPC classification number: G01C21/3492 ,  G01C21/3664 ,  G01C21/3691 ,  H04W4/40

Abstract: Example embodiments relate to using remote assistance for vehicle navigation. An example apparatus may comprise a memory configured to store navigation options and a computing device. The computing device may be configured to receive a request for assistance comprising a situation to be encountered by a vehicle along a planned travel route and to determine one or more navigation options for enabling the vehicle to navigate the situation. The computing device may also be configured to select at least one navigation option of the one or more navigation options. Further, the computing device may be configured to generate a response to the request for assistance that includes instructions for performing the at least one navigation option to navigate the situation and to send the response to the vehicle for execution of the instructions.

公开(公告)号：US20230192134A1

公开(公告)日：2023-06-22

申请号：US17557908

申请日：2021-12-21

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: B60W60/00 ,  G06V20/56 ,  G08G1/0969

CPC classification number: B60W60/0015 ,  G06V20/56 ,  G08G1/0969 ,  B60W2420/42 ,  B60W2554/4049

Abstract: Example embodiments relate to techniques for providing incremental remote assistance to a vehicle. A computing device initially receives location information from a vehicle that is autonomously navigating to a destination. Based on the location information, the computing device displays a representation of an environment of the vehicle and receives a first input specifying a first waypoint and a second input specifying a second waypoint positioned on the representation of the environment. The computing device is configured to limit a location of the first waypoint based on a first location of the vehicle, and a location of the second waypoint based on a second location of the vehicle or the location of the first waypoint. The computing device can then provide route instructions to the vehicle based on at least the first waypoint or the second waypoint.

公开(公告)号：US20220066440A1

公开(公告)日：2022-03-03

申请号：US17004839

申请日：2020-08-27

Applicant: Waymo LLC

Inventor： Ioan-Alexandru Sucan ,  Collin Winter ,  Chien-Yu Ko ,  Vishay Nihalani

IPC: G05D1/00 ,  B60W60/00

Abstract: Example embodiments relate to gradually adjusting a vehicle sensor perspective using remote assistance. A computing device may receive a request for assistance from a vehicle operating in an environment. The request indicates that the vehicle is stopped at a location with a sensor perspective of the environment that is at least partially occluded. Responsive to receiving the request for assistance, the computing device may display a graphical user interface (GUI) that represents a current state of the vehicle and includes a selectable option configured to enable the vehicle to gradually move forward a predefined distance. The computing device may detect a selection of the selectable option and transmit instructions that enable the vehicle to gradually move forward the predefined distance. The vehicle can then gradually move forward the predefined distance while also monitoring for one or more changes in the environment responsive to receiving the instructions.

公开(公告)号：US20250044792A1

公开(公告)日：2025-02-06

申请号：US18921915

申请日：2024-10-21

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: G05D1/00 ,  G06T7/70 ,  G06V20/58 ,  H04W4/40

Abstract: Example embodiments relate to techniques for enabling one or more systems of a vehicle (e.g., an autonomous vehicle) to request remote assistance to help the vehicle navigate in an environment. A computing device may be configured to receive a request for assistance from a vehicle. The request may include an image frame representative of a portion of an environment. The computing device may also be configured to initiate display of a graphical user interface to visually represent the image frame. Further, the computing device may determine a bounding region for the image frame. The bounding region may be associated with one or more objects in the image frame. Additionally, the computing device may be configured to receive, via the GUI, an input that includes an object identifier, and associate the object identifier with each of the one or more objects in the bounding region.

公开(公告)号：US20250018978A1

公开(公告)日：2025-01-16

申请号：US18896422

申请日：2024-09-25

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: B60W60/00 ,  G01C21/34 ,  G06F3/04842 ,  G06T11/00

Abstract: Example embodiments relate to user interface techniques for recommending remote assistance actions. A remote computing device may display a representation of the forward path for an autonomous vehicle based on sensor data received from the vehicle. The computing device may augment the representation of the forward path to further depict one or more proposed trajectories available for the autonomous vehicle to perform. Each proposed trajectory conveys one or more maneuvers positioned relative to road boundaries in the forward path. The computing device may receive a selection of a proposed trajectory from the one or more proposed trajectories available for the autonomous vehicle to perform and provide navigation instructions to the vehicle based on the proposed trajectory.

公开(公告)号：US20230350405A1

公开(公告)日：2023-11-02

申请号：US18342187

申请日：2023-06-27

Applicant: Waymo LLC

Inventor： Ioan-Alexandru Sucan ,  Collin Winter ,  Chien-Yu Ko ,  Vishay Nihalani

IPC: G05D1/00 ,  B60W60/00

CPC classification number: G05D1/0016 ,  B60W60/005 ,  B60W60/001 ,  G05D1/0022 ,  G05D1/0088 ,  G05D2201/0213

Abstract: Example embodiments relate to gradually adjusting a vehicle sensor perspective using remote assistance. A computing device may receive a request for assistance from a vehicle operating in an environment. The request indicates that the vehicle is stopped at a location with a sensor perspective of the environment that is at least partially occluded. Responsive to receiving the request for assistance, the computing device may display a graphical user interface (GUI) that represents a current state of the vehicle and includes a selectable option configured to enable the vehicle to gradually move forward a predefined distance. The computing device may detect a selection of the selectable option and transmit instructions that enable the vehicle to gradually move forward the predefined distance. The vehicle can then gradually move forward the predefined distance while also monitoring for one or more changes in the environment responsive to receiving the instructions.

公开(公告)号：US20230192129A1

公开(公告)日：2023-06-22

申请号：US17558062

申请日：2021-12-21

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: B60W60/00 ,  G01C21/34 ,  G06T11/00

CPC classification number: B60W60/0011 ,  B60W60/0027 ,  G01C21/3461 ,  G06T11/001 ,  B60W2420/42 ,  B60W2554/801 ,  B60W2554/802 ,  B60W2556/45 ,  G06F3/04842

Abstract: Example embodiments relate to user interface techniques for recommending remote assistance actions. A remote computing device may display a representation of the forward path for an autonomous vehicle based on sensor data received from the vehicle. The computing device may augment the representation of the forward path to further depict one or more proposed trajectories available for the autonomous vehicle to perform. Each proposed trajectory conveys one or more maneuvers positioned relative to road boundaries in the forward path. The computing device may receive a selection of a proposed trajectory from the one or more proposed trajectories available for the autonomous vehicle to perform and provide navigation instructions to the vehicle based on the proposed trajectory.

公开(公告)号：US20230192124A1

公开(公告)日：2023-06-22

申请号：US18064612

申请日：2022-12-12

Applicant: Waymo LLC

Inventor： Collin Winter ,  Vishay Nihalani

IPC: B60W60/00 ,  B60W50/14 ,  B60R1/22

CPC classification number: B60W60/001 ,  B60R1/22 ,  B60W50/14 ,  B60W2050/146 ,  B60W2420/42

Abstract: Example embodiments relate to techniques for providing remote assistance to an autonomous vehicle. A computing device may receive location from a vehicle while the vehicle is autonomously navigating a path in an environment. Based on the location information, the computing device may display a representation of the environment of the vehicle that conveys lane information for the path and subsequently receive an input selecting a lane in the path. The input modified an availability of the lane in the path during subsequent navigation by the vehicle. The computing device may then provide navigation instructions to the vehicle based on availability of the lane in the path.

公开(公告)号：US11535276B2

公开(公告)日：2022-12-27

申请号：US17013996

申请日：2020-09-08

Applicant: Waymo LLC

Inventor： Ioan-Alexandru Sucan ,  Joshua Herbach ,  Collin Winter

IPC: B60W60/00 ,  G05D1/00

Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.

公开(公告)号：US20220073097A1

公开(公告)日：2022-03-10

申请号：US17013996

申请日：2020-09-08

Applicant: Waymo LLC

Inventor： Ioan-Alexandru Sucan ,  Joshua Herbach ,  Collin Winter

IPC: B60W60/00 ,  G05D1/00

Abstract: Example embodiments relate to using remote assistance to maneuver an autonomous vehicle to a location. A computing device used by a remote operator may receive a request for assistance from a vehicle that indicates the vehicle is stopped at a first location with one or more navigation options for enabling the vehicle to navigate from the first location to a second location. At least one navigation option includes a maneuver technique that requires operator approval prior to execution. The computing device may then display a graphical user interface (GUI) that conveys the one or more navigation options. Based on detecting a selection of a particular navigation option, the computing device may transmit instructions to the vehicle to perform the particular navigation option. The vehicle may configured to navigate from the first location to the second location by performing the particular navigation option while monitoring for changes in the environment.