-
21.
公开(公告)号:US20200074266A1
公开(公告)日:2020-03-05
申请号:US16559945
申请日:2019-09-04
Applicant: Luminar Technologies, Inc.
Inventor: Miguel Alexander Peake , Benjamin Englard
IPC: G06N3/00 , G06N20/00 , G06N5/04 , G06F13/28 , G06K9/62 , G06T7/246 , G06K9/00 , G06T7/50 , G05D1/00 , G05D1/02 , G01S7/48 , G01C21/28
Abstract: Automated training dataset generators that generate feature training datasets for use in real-world autonomous driving applications based on virtual environments are disclosed herein. The feature training datasets may be associated with training a machine learning model to control real-world autonomous vehicles. In some embodiments, an occupancy grid generator is used to generate an occupancy grid indicative of an environment of an autonomous vehicle from an imaging scene that depicts the environment. The occupancy grid is used to control the vehicle as the vehicle moves through the environment. In further embodiments, a sensor parameter optimizer may determine parameter settings for use by real-world sensors in autonomous driving applications. The sensor parameter optimizer may determine, based on operation of the autonomous vehicle, an optimal parameter setting of the parameter setting where the optimal parameter setting may be applied to a real-world sensor associated with real-world autonomous driving applications.
-
22.
公开(公告)号:US20200074233A1
公开(公告)日:2020-03-05
申请号:US16560018
申请日:2019-09-04
Applicant: Luminar Technologies, Inc.
Inventor: Benjamin Englard , Miguel Alexander Peake
IPC: G06K9/62 , G06N3/00 , G06T11/60 , G08G1/0962
Abstract: Automated training dataset generators that generate feature training datasets for use in real-world autonomous driving applications based on virtual environments are disclosed herein. The feature training datasets may be associated with training a machine learning model to control real-world autonomous vehicles. In some embodiments, an occupancy grid generator is used to generate an occupancy grid indicative of an environment of an autonomous vehicle from an imaging scene that depicts the environment. The occupancy grid is used to control the vehicle as the vehicle moves through the environment. In further embodiments, a sensor parameter optimizer may determine parameter settings for use by real-world sensors in autonomous driving applications. The sensor parameter optimizer may determine, based on operation of the autonomous vehicle, an optimal parameter setting of the parameter setting where the optimal parameter setting may be applied to a real-world sensor associated with real-world autonomous driving applications.
-
公开(公告)号:US20200043176A1
公开(公告)日:2020-02-06
申请号:US16196630
申请日:2018-11-20
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Tomi P. Maila , Pranav Maheshwari , Benjamin Englard
Abstract: A computer-implemented method of determining relative velocity between a vehicle and an object. The method includes receiving sensor data generated by one or more sensors of the vehicle configured to sense an environment by following a scan pattern comprising component scan lines. The method includes obtaining, based on the sensor data, a point cloud frame. Additionally, the method includes identifying a first pixel and a second pixel that are co-located within a field of regard and overlap a point cloud object within the point cloud frame and calculating a difference between a depth associated with the first pixel and a depth associated with the second pixel. The method includes determining a relative velocity of the point cloud object by dividing the difference in depth data by a time difference between when the depth associated with the first pixel was sensed and the depth associated with the second pixel was sensed.
-
公开(公告)号:US10394243B1
公开(公告)日:2019-08-27
申请号:US16138582
申请日:2018-09-21
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Vahid R. Ramezani , Benjamin Englard , Tomi P. Maila
IPC: G05D1/02 , G05D1/00 , B60W50/029
Abstract: Various software techniques for managing operation of autonomous vehicles based on sensor data are disclosed herein. A computing system may generate, based on a set of signals descriptive of a current state of an environment in which the autonomous vehicle is operating, a normal path plan separate from a safe path plan, or a hybrid path plan including a normal path plan and a safe path plan. In generating the safe path plan, the computing system may generate and concatenate a set of motion primitives. When a fault condition occurs, the computing device may transition from executing the normal path plan to executing the safe path plan to safely stop the autonomous vehicle.
-
公开(公告)号:US10338223B1
公开(公告)日:2019-07-02
申请号:US16176649
申请日:2018-10-31
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Benjamin Englard , Eric C. Danziger
IPC: G01S17/89 , G05D1/02 , B60W30/18 , G06T7/50 , G06K9/42 , G06N3/08 , G05D1/00 , G06K9/62 , G06K9/00 , G06T7/20
Abstract: A method for processing point clouds having variable spatial distributions of scan lines includes receiving a point cloud frame generated by a sensor configured to sense a vehicle environment. Each of the points in the frame has associated two-dimensional coordinates and an associated parameter value. The method also includes generating a normalized point cloud frame by adding interpolated points not present in the received frame, at least by, for each interpolated point, identifying one or more neighboring points having associated two-dimensional coordinates that are within a threshold distance of two-dimensional coordinates for the interpolated point, and calculating an estimated parameter value of the interpolated point using, for each of the identified neighboring points, a distance between the two-dimensional coordinates and the parameter value associated with the identified neighboring point. The method also includes generating, using the normalized point cloud frame, signals descriptive of a current state of the vehicle environment.
-
26.
公开(公告)号:US20190179026A1
公开(公告)日:2019-06-13
申请号:US16176624
申请日:2018-10-31
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Benjamin Englard , Eric C. Danziger , Austin K. Russell
Abstract: A method for controlling at least a first sensor of a vehicle, which senses an environment through which the vehicle is moving by producing a plurality of scan lines arranged according to a spatial distribution, includes receiving sensor data generated by one or more sensors. The one or more sensors are configured to sense the environment through which the vehicle is moving. The method also includes identifying, by one or more processors and based on the received sensor data, one or more areas of interest in the environment, and causing, by one or more processors and based on the areas of interest, the spatial distribution of the plurality of scan lines produced by the first sensor to be adjusted.
-
27.
公开(公告)号:US20190178988A1
公开(公告)日:2019-06-13
申请号:US16176529
申请日:2018-10-31
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Benjamin Englard , Eric C. Danziger
IPC: G01S7/40 , G01S13/93 , G01S7/41 , G01S13/42 , G05D1/00 , G05D1/02 , B60W30/18 , B60W10/04 , G06N3/08
Abstract: A method for configuring a perception component of a vehicle having one or more sensors includes generating a first set of training data that includes first sensor data corresponding to a first setting of one or more sensor parameters, and an indicator of the first setting. The method also includes generating a second set of training data that includes second sensor data corresponding to a second setting of the sensor parameter(s), and an indicator of the second setting. The method further includes training the perception component, at least by training a machine learning based model using the first and second training data sets. The trained perception component is configured to generate signals descriptive of a current state of the vehicle environment by processing sensor data generated by the sensor(s), and one or more indicators indicating which setting of the sensor parameter(s) corresponds to which portions of the generated sensor data.
-
公开(公告)号:US12033334B2
公开(公告)日:2024-07-09
申请号:US17839448
申请日:2022-06-13
Applicant: Luminar Technologies, Inc.
Inventor: Vahid R. Ramezani , Akshay Rangesh , Benjamin Englard , Siddhesh S. Mhatre , Meseret R. Gebre , Pranav Maheshwari
CPC classification number: G06T7/246 , G06N3/044 , G06N3/08 , G06T7/73 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084
Abstract: A sequence of images generated at respective times by one or more sensors configured to sense an environment through which objects are moving relative to the one or more sensors is received. A message passing graph having a multiplicity of layers associated with the sequence of images is constructed. A neural network supported by the message passing graph is trained. The training includes performing a pass through the message passing graph in a forward direction including by adding a new feature node based on a feature detection and a new edge node and performing a pass through the message passing graph in a backward direction, including by updating at least one edge node of the message passing graph. Multiple features are tracked through the sequence of images, including passing messages through the message passing graph.
-
公开(公告)号:US10768304B2
公开(公告)日:2020-09-08
申请号:US16176567
申请日:2018-10-31
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Benjamin Englard , Eric C. Danziger , Austin K. Russell
IPC: G06K9/00 , G01S17/89 , G01S7/40 , G01S7/41 , G01S13/42 , G05D1/00 , G05D1/02 , B60W30/18 , B60W10/04 , G06N3/08 , G01S13/931 , G06K9/62 , G01S17/86 , G01S17/931 , G06T3/40 , G06T17/05 , G06T17/20 , G01S7/48 , G01S7/481 , G06T7/50 , G06K9/42 , G01S17/66 , G06T15/08 , G01S7/497 , B60W50/06 , G06T7/20
Abstract: A method for processing point clouds having variable spatial distributions of scan lines includes receiving a point cloud frame generated by a sensor configured to sense an environment through which a vehicle is moving. The point cloud frame includes scan lines arranged according to a particular spatial distribution. The method also includes either generating an enhanced point cloud frame with a larger number of points than the received point cloud frame, or constructing, by one or more processors and based on points of the received point cloud frame, a three-dimensional mesh. The method also includes generating, by performing an interpolation function on the enhanced point cloud frame or a virtual surface provided by the three-dimensional mesh, a normalized point cloud frame, and generating, using the normalized point cloud frame, signals descriptive of a current state of the environment through which the vehicle is moving.
-
30.
公开(公告)号:US10754037B2
公开(公告)日:2020-08-25
申请号:US16176582
申请日:2018-10-31
Applicant: LUMINAR TECHNOLOGIES, INC.
Inventor: Benjamin Englard , Eric C. Danziger
IPC: G01S17/89 , G01S7/40 , G01S7/41 , G01S13/42 , G05D1/00 , G05D1/02 , B60W30/18 , B60W10/04 , G06N3/08 , G01S13/931 , G06K9/62 , G01S17/86 , G01S17/931 , G06T3/40 , G06T17/05 , G06T17/20 , G01S7/48 , G01S7/481 , G06T7/50 , G06K9/42 , G01S17/66 , G06K9/00 , G06T15/08 , G01S7/497 , B60W50/06 , G06T7/20
Abstract: A method for processing point clouds having variable spatial distributions of scan lines includes receiving a point cloud portion corresponding to an object in a vehicle environment, the point cloud portion including scan lines arranged according to a particular spatial distribution. The method also includes constructing a voxel grid corresponding to the received point cloud portion. The voxel grid includes a plurality of volumes in a stacked, three-dimensional arrangement, and constructing the voxel grid includes (i) determining an initial classification of the object, (ii) setting one or more parameters of the voxel grid based on the initial classification, and (iii) associating each volume of the plurality of volumes with an attribute specifying how many points, from the point cloud portion, fall within that volume. The method also includes generating, using the constructed voxel grid, signals descriptive of a current state of the environment through which the vehicle is moving.
-
-
-
-
-
-
-
-
-