-
公开(公告)号:US20220343657A1
公开(公告)日:2022-10-27
申请号:US17862499
申请日:2022-07-12
Applicant: Waymo LLC
Inventor: Hyman Murveit , Abhijit Ogale , Yu-Han Chen , Alper Ayvaci
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a future occupancy prediction for a region of an environment. In one aspect, a method comprises: receiving sensor data generated by a sensor system of a vehicle that characterizes an environment in a vicinity of the vehicle as of a current time point, wherein the sensor data comprises a plurality of sensor samples characterizing the environment that were each captured at different time points; processing a network input comprising the sensor data using a neural network to generate an occupancy prediction output for a region of the environment, wherein: the occupancy prediction output characterizes, for one or more future intervals of time after the current time point, a respective likelihood that the region of the environment will be occupied by an agent in the environment during the future interval of time.
-
公开(公告)号:US11443525B1
公开(公告)日:2022-09-13
申请号:US16747380
申请日:2020-01-20
Applicant: Waymo LLC
Inventor: Vadim Furman , Andrew Hughes Chatham , Abhijit Ogale , Dmitri Dolgov
IPC: G06V20/58 , G01C21/00 , G06T9/00 , H04N19/17 , H04N19/117 , B60R11/04 , H04N19/85 , H04N19/167 , H04N19/136 , G06V10/75 , B60R11/00 , G06V20/56
Abstract: A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.
-
公开(公告)号:US20190101928A1
公开(公告)日:2019-04-04
申请号:US16191835
申请日:2018-11-15
Applicant: Waymo LLC
Inventor: Wan-Yen Lo , David Ian Franklin Ferguson , Abhijit Ogale
CPC classification number: G05D1/0246 , G05D2201/0212 , G06K9/00825 , G06K9/4652 , G06K9/4661 , G06K9/50
Abstract: A computing device of a first vehicle may receive a first image and a second image of a second vehicle having flashing light signals. The computing device may determine, in the first image and the second image, an image region that bounds the second vehicle such that the image region substantially encompasses the second vehicle. The computing device may determine a polar grid that partitions the image region in the first image and the second image into polar bins, and identify portions of image data exhibiting a change in color and a change in brightness between the first image and the second image. The computing device may determine a type of the flashing light signals and a type of the second vehicle; and accordingly provide instructions to control the first vehicle.
-
公开(公告)号:US10203697B2
公开(公告)日:2019-02-12
申请号:US15837501
申请日:2017-12-11
Applicant: Waymo LLC
Inventor: Abhijit Ogale
Abstract: The present disclosure is directed to an autonomous vehicle having a vehicle control system. The vehicle control system includes a vehicle detection system. The vehicle detection system includes receiving an image of a field of view of the vehicle and identifying a region-pair in the image with a sliding-window filter. The region-pair is made up of a first region and a second region. Each region is determined based on a color of pixels within the sliding-window filter. The vehicle detection system also determines a potential second vehicle in the image based on the region-pair. In response to determining the potential second vehicle in the image, the vehicle detection system performs a multi-stage classification of the image to determine whether the second vehicle is present in the image. Additionally, the vehicle detection system provides instructions to control the first vehicle based at least on the determined second vehicle.
-
公开(公告)号:US10173673B1
公开(公告)日:2019-01-08
申请号:US15399613
申请日:2017-01-05
Applicant: Waymo LLC
Inventor: David Ian Franklin Ferguson , Abhijit Ogale
Abstract: The present disclosure is directed to autonomous vehicle having a vehicle control system. The vehicle control system includes a processing system that receives input values that indicate attributes of an object within a threshold distance of the autonomous vehicle and variance values indicating uncertainty associated with the input values. The processing system also provides a plurality of outcomes that are associated with combinations of split decisions. A given split decision indicates whether a particular input value is above or below a threshold value associated with the given split decision. The processing system further determines (i) a probability that the particular input value is above a threshold value and (ii) a probability that the particular input is below the threshold value for a given split decision. Additionally, the processing system determines one or more likelihoods associated with a given outcome. Further, the processing system provides instructions to control the autonomous vehicle.
-
公开(公告)号:US10013773B1
公开(公告)日:2018-07-03
申请号:US15381288
申请日:2016-12-16
Applicant: Waymo LLC
Inventor: Abhijit Ogale , Alexander Krizhevsky , Wan-Yen Lo
CPC classification number: G06N3/08 , G06K9/00791 , G06K9/627 , G06K9/68 , G06N3/0454 , G06N3/084 , G06T7/74 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
Abstract: A neural network system for identifying positions of objects in an input image can include an object detector neural network, a memory interface subsystem, and an external memory. The object detector neural network is configured to, at each time step of multiple successive time steps, (i) receive a first neural network input that represents the input image and a second neural network input that identifies a first set of positions of the input image that have each been classified as showing a respective object of the set of objects, and (ii) process the first and second inputs to generate a set of output scores that each represents a respective likelihood that an object that is not one of the objects shown at any of the positions in the first set of positions is shown at a respective position of the input image that corresponds to the output score.
-
公开(公告)号:US09804597B1
公开(公告)日:2017-10-31
申请号:US14855009
申请日:2015-09-15
Applicant: Waymo LLC
Inventor: Dave Ferguson , Abhijit Ogale
CPC classification number: G05D1/0088 , B60W30/00 , G01S13/02 , G01S17/02 , G01S19/13 , G05D1/0231 , G05D1/0246 , G05D2201/0213 , G06K9/00805 , G06K9/00825
Abstract: Methods and systems for the use of detected objects for image processing are described. A computing device autonomously controlling a vehicle may receive images of the environment surrounding the vehicle from an image-capture device coupled to the vehicle. In order to process the images, the computing device may receive information indicating characteristics of objects in the images from one or more sources coupled to the vehicle. Examples of sources may include RADAR, LIDAR, a map, sensors, a global positioning system (GPS), or other cameras. The computing device may use the information indicating characteristics of the objects to process received images, including determining the approximate locations of objects within the images. Further, while processing the image, the computing device may use information from sources to determine portions of the image to focus upon that may allow the computing device to determine a control strategy based on portions of the image.
-
公开(公告)号:US11928866B2
公开(公告)日:2024-03-12
申请号:US17567729
申请日:2022-01-03
Applicant: Waymo LLC
Inventor: Abhijit Ogale , Alexander Krizhevsky
CPC classification number: G06V20/58 , G05D1/0221 , G06N3/045 , G06N3/08 , G06N3/084 , B60R2300/8093
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for selecting locations in an environment of a vehicle where objects are likely centered and determining properties of those objects. One of the methods includes receiving an input characterizing an environment external to a vehicle. For each of a plurality of locations in the environment, a respective first object score that represents a likelihood that a center of an object is located at the location is determined. Based on the first object scores, one or more locations from the plurality of locations are selected as locations in the environment at which respective objects are likely centered. Object properties of the objects that are likely centered at the selected locations are also determined.
-
公开(公告)号:US11831868B2
公开(公告)日:2023-11-28
申请号:US17817579
申请日:2022-08-04
Applicant: Waymo LLC
Inventor: Vadim Furman , Andrew Hughes Chatham , Abhijit Ogale , Dmitri Dolgov
IPC: G06T9/00 , H04N19/117 , B60R11/04 , H04N19/136 , H04N19/17 , H04N19/167 , H04N19/85 , G06V20/58 , G01C21/00 , B60R11/00 , G06V20/56
CPC classification number: H04N19/117 , B60R11/04 , G01C21/3896 , G06T9/00 , G06V20/58 , H04N19/136 , H04N19/167 , H04N19/17 , H04N19/85 , B60R2011/004 , B60R2011/008 , B60R2011/0026 , G06V20/56
Abstract: A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.
-
公开(公告)号:US20220375232A1
公开(公告)日:2022-11-24
申请号:US17817579
申请日:2022-08-04
Applicant: Waymo LLC
Inventor: Vadim Furman , Andrew Hughes Chatham , Abhijit Ogale , Dmitri Dolgov
IPC: G06V20/58 , G06V10/75 , H04N19/167 , H04N19/17 , H04N19/117 , H04N19/85 , G01C21/00 , G06T9/00 , B60R11/04 , H04N19/136
Abstract: A vehicle may receive one or more images of an environment of the vehicle. The vehicle may also receive a map of the environment. The vehicle may also match at least one feature in the one or more images with corresponding one or more features in the map. The vehicle may also identify a given area in the one or more images that corresponds to a a portion of the map that is within a threshold distance to the one or more features. The vehicle may also compress the one or more images to include a lower amount of details in areas of the one or more images other than the given area. The vehicle may also provide the compressed images to a remote system, and responsively receive operation instructions from the remote system.
-
-
-
-
-
-
-
-
-