ACCELERATED DEEP REINFORCEMENT LEARNING OF AGENT CONTROL POLICIES

    公开(公告)号:US20220036186A1

    公开(公告)日:2022-02-03

    申请号:US17390800

    申请日:2021-07-30

    Applicant: Waymo LLC

    Abstract: Methods, computer systems, and apparatus, including computer programs encoded on computer storage media, for training a mixture of a plurality of actor-critic policies that is used to control an agent interacting with an environment to perform a task. Each actor-critic policy includes an actor policy and a critic policy. The training includes, for each of one or more transitions, determining a target Q value for the transition from (i) the reward in the transition, and (ii) an imagined return estimate generated by performing one or more iterations of a prediction process to generate one or more predicted future transitions.

    Contactless Electrical Coupling for a Rotatable LIDAR Device

    公开(公告)号:US20220032791A1

    公开(公告)日:2022-02-03

    申请号:US17502846

    申请日:2021-10-15

    Applicant: Waymo LLC

    Abstract: A rotatable LIDAR device including contactless electrical couplings is disclosed. An example rotatable LIDAR device includes a vehicle electrical coupling including (i) a first conductive ring, (ii) a second conductive ring, and (iii) a first coil. The example rotatable LIDAR device further includes a LIDAR electrical coupling including (i) a third conductive ring, (ii) a fourth conductive ring, and (iii) a second coil. The example rotatable LIDAR device still further includes a rotatable LIDAR electrically coupled to the LIDAR electrical coupling. The first conductive ring and the third conductive ring form a first capacitor configured to transmit communications to the rotatable LIDAR, the second conductive ring and the fourth conductive ring form a second capacitor configured to transmit communications from the rotatable LIDAR, and the first coil and the second coil form a transformer configured to provide power to the rotatable LIDAR.

    SELF-DRIVING VEHICLES AND WEIGH STATION OPERATION

    公开(公告)号:US20220028191A1

    公开(公告)日:2022-01-27

    申请号:US17410402

    申请日:2021-08-24

    Applicant: WAYMO LLC

    Inventor: Vijaysai Patnaik

    Abstract: The technology involves operation of a self-driving truck or other cargo vehicle when it is being inspected at a weigh station. This may include determining whether a weigh station is open for inspection. Once at the weigh station, the vehicle may follow instructions of an inspection officer or autonomous inspection system. The vehicle may perform predefined actions or operations so that various vehicle systems and safety issues can be evaluated, such as the brakes, lights, tires, connections between the tractor and trailer, exposed fuel tanks, leaks, etc. A visual inspection may be performed to ensure the load is secured, vehicle and cargo documents meet certain criteria, and the carrier's safety record meets any requirements. In addition, the weigh station itself may be operated in a partly or fully autonomous mode when dealing with autonomous and manually driven vehicles.

    Stabilizing Power Output
    355.
    发明申请

    公开(公告)号:US20220019034A1

    公开(公告)日:2022-01-20

    申请号:US16928621

    申请日:2020-07-14

    Applicant: Waymo LLC

    Abstract: The present disclosure relates to transmitter modules, vehicles, and methods associated with lidar sensors. An example transmitter module could include a light-emitter die and a plurality of light-emitter devices coupled to the light-emitter die. Each light-emitter of the plurality of light-emitter devices is configured to emit light from a respective emitter surface. The transmitter module also includes a cylindrical lens optically coupled to the plurality of light-emitter devices and arranged along an axis. The light-emitter die is disposed such that the respective emitter surfaces of the plurality of light-emitter devices form a non-zero yaw angle with respect to the axis.

    Multilayer Optical Devices and Systems

    公开(公告)号:US20220018942A1

    公开(公告)日:2022-01-20

    申请号:US17490428

    申请日:2021-09-30

    Applicant: Waymo LLC

    Abstract: One example system comprises a plurality of substrates disposed in an overlapping arrangement. The plurality of substrates includes at least a first substrate and a second substrate. The system also comprises a first waveguide disposed on the first substrate to define a first optical path on the first substrate. The first waveguide is configured to guide light along the first optical path and to transmit, at an output section of the first waveguide, the light out of the first waveguide toward the second substrate. The system also comprises a second waveguide disposed on the second substrate to define a second optical path on the second substrate. An input section of the second waveguide is aligned with the output section of the first waveguide to receive the light transmitted by the first waveguide. The second waveguide is configured to guide the light along the second optical path.

    Detecting and responding to people directing traffic for autonomous vehicles

    公开(公告)号:US11226626B1

    公开(公告)日:2022-01-18

    申请号:US16713568

    申请日:2019-12-13

    Applicant: Waymo LLC

    Abstract: The technology relates to detecting a person directing traffic. For instance, a first vehicle may be controlled in an autonomous driving mode. Sensor data is received from a perception system of the first vehicle, the sensor data identifying a person. Behavior of the person is observed using the sensor data. The observed behavior of the person and the observed behavior of a second vehicle are used to determine a likelihood value indicative of whether the person is directing traffic. The first vehicle is maneuvered in the autonomous driving mode based on the determined likelihood value.

    Detection of anomalous trailer behavior

    公开(公告)号:US11226623B2

    公开(公告)日:2022-01-18

    申请号:US16373741

    申请日:2019-04-03

    Applicant: Waymo LLC

    Abstract: The technology relates to determining whether a vehicle operating in an autonomous driving mode is experiencing an anomalous condition, for instance due to a loss of tire pressure, a mechanical failure, or a shift or loss of cargo. The actual current pose of the vehicle is compared to an expected pose of the vehicle, where the expected pose is based on a model of the vehicle. If a pose discrepancy is identified, the anomalous condition is determined from information associated with the pose discrepancy. The vehicle is then able to take corrective action based on the nature of the anomalous condition. The corrective action may include making a real-time driving change, modifying a planned route, alerting a remote operations center, or communicating with one or more other vehicles.

    Vehicle Sensor Verification and Calibration

    公开(公告)号:US20210389763A1

    公开(公告)日:2021-12-16

    申请号:US17412599

    申请日:2021-08-26

    Applicant: Waymo LLC

    Abstract: An example method involves detecting a sensor-testing trigger. Detecting the sensor-testing trigger may comprise determining that a vehicle is within a threshold distance to a target in an environment of the vehicle. The method also involves obtaining sensor data collected by a sensor of the vehicle after the detection of the sensor-testing trigger. The sensor data is indicative of a scan of a region of the environment that includes the target. The method also involves comparing the sensor data with previously-collected sensor data indicating detection of the target by one or more sensors during one or more previous scans of the environment. The method also involves generating performance metrics related to the sensor of the vehicle based on the comparison.

Patent Agency Ranking