SYSTEM FOR CALIBRATING EXTRINSIC PARAMETERS FOR A CAMERA IN AN AUTONOMOUS VEHICLE

    公开(公告)号:US20230281872A1

    公开(公告)日:2023-09-07

    申请号:US17688157

    申请日:2022-03-07

    Inventor: Farui Peng Hao Yu

    CPC classification number: G06T7/80 G06T7/73 G06T7/246 G06T7/292 G06T2207/30248

    Abstract: A system for determining calibrated camera extrinsic parameters for an autonomous vehicle includes a camera mounted to the autonomous vehicle collecting image data including a plurality of image frames. The system also includes one or more automated driving controllers in electronic communication with the camera that executes instructions to determine a vehicle pose estimate based on position and movement of the autonomous vehicle by a localization algorithm. The one or more automated driving controllers determine the calibrated camera extrinsic parameters based on three dimensional coordinates for specific feature points of interests corresponding to two sequential image frames, the specific feature points of interests corresponding to the two sequential image frames, and the camera pose corresponding to the two sequential image frames.

    METHODS AND SYSTEMS FOR CAMERA TO GROUND ALIGNMENT

    公开(公告)号:US20230260291A1

    公开(公告)日:2023-08-17

    申请号:US17651405

    申请日:2022-02-16

    Abstract: Methods and systems for a vehicle are provided. In one embodiment, the method includes: receiving image data defining a plurality of images associated with an environment of the vehicle; determining, by a processor, feature points within at least one image of the plurality of images; selecting, by the processor, a subset of the feature points as ground points; determining, by the processor, a ground plane based on the subset of feature points; determining, by the processor, a ground normal vector from the ground plane; determining, by the processor, the ground normal vector based on a sliding widow method; determining, by the processor, a camera to ground alignment value based on the ground normal vector; and generating, by the processor, second image data based on the camera to ground alignment value.

    ON-VEHICLE CAMERA ALIGNMENT MONITORING SYSTEM

    公开(公告)号:US20230215045A1

    公开(公告)日:2023-07-06

    申请号:US17567371

    申请日:2022-01-03

    Abstract: A system for on-vehicle camera alignment monitoring includes an on-vehicle camera in communication with a controller. The controller monitors vehicle operating parameters and camera signal parameters, and captures an image file from the on-vehicle camera. A first level analysis of the image file, the vehicle operating parameters, and the camera signal parameters is executed to detect dynamic conditions and image feature parameters that affect camera alignment. An error with one of the dynamic conditions or the image feature parameters that affects the camera alignment is detected. A second level analysis of the camera signal parameters is executed to identify a root cause indicating one of the dynamic conditions or the image feature parameters that affects the camera alignment based upon the error. A camera alignment-related fault is detected based upon the root cause, and vehicle operation is controlled based upon the camera alignment-related fault.

    COLLABORATIVE ESTIMATION AND CORRECTION OF LIDAR BORESIGHT ALIGNMENT ERROR AND HOST VEHICLE LOCALIZATION ERROR

    公开(公告)号:US20220390607A1

    公开(公告)日:2022-12-08

    申请号:US17339626

    申请日:2021-06-04

    Abstract: A LIDAR-to-vehicle alignment system includes a memory and an autonomous driving module. The memory stores points of data provided based on an output of a LIDAR sensor and GPS locations. The autonomous driving module performs an alignment process including performing feature extraction on the points of data to detect one or more features of one or more predetermined types of objects having one or more predetermined characteristics. The features are determined to correspond to one or more targets because the features have the predetermined characteristics. One or more of the GPS locations are of the targets. The alignment process further includes: determining ground-truth positions of the features; correcting the GPS locations based on the ground-truth positions; calculating a LIDAR-to-vehicle transform based on the corrected GPS locations; and based on results of the alignment process, determining whether one or more alignment conditions are satisfied.

    DYNAMIC LIDAR ALIGNMENT
    36.
    发明申请

    公开(公告)号:US20210373138A1

    公开(公告)日:2021-12-02

    申请号:US16887397

    申请日:2020-05-29

    Abstract: Systems and method are provided for controlling a vehicle. In one embodiment, a method includes: recording, by a controller onboard the vehicle, lidar data from the lidar device while the vehicle is travelling on a straight road; determining, by the controller, that the vehicle is travelling straight on the straight road; detecting, by the controller, straight lane marks on the straight road; computing, by the controller, lidar boresight parameters based on the straight lane marks; calibrating, by the controller, the lidar device based on the lidar boresight parameters; and controlling, by the controller, the vehicle based on data from the calibrated lidar device.

    On-vehicle camera alignment monitoring system

    公开(公告)号:US12106518B2

    公开(公告)日:2024-10-01

    申请号:US17567371

    申请日:2022-01-03

    Abstract: A system for on-vehicle camera alignment monitoring includes an on-vehicle camera in communication with a controller. The controller monitors vehicle operating parameters and camera signal parameters, and captures an image file from the on-vehicle camera. A first level analysis of the image file, the vehicle operating parameters, and the camera signal parameters is executed to detect dynamic conditions and image feature parameters that affect camera alignment. An error with one of the dynamic conditions or the image feature parameters that affects the camera alignment is detected. A second level analysis of the camera signal parameters is executed to identify a root cause indicating one of the dynamic conditions or the image feature parameters that affects the camera alignment based upon the error. A camera alignment-related fault is detected based upon the root cause, and vehicle operation is controlled based upon the camera alignment-related fault.

    METHODS AND SYSTEMS FOR CAMERA TO GROUND ALIGNMENT

    公开(公告)号:US20230256975A1

    公开(公告)日:2023-08-17

    申请号:US17651406

    申请日:2022-02-16

    CPC classification number: B60W40/10 G06V20/58 B60W2420/42 B60W2552/53

    Abstract: Systems and methods for a vehicle are provided. In one embodiment, a method includes: receiving image data defining a plurality of images associated with an environment of the vehicle; receiving vehicle data indicating a velocity of the vehicle, wherein the vehicle data is associated with the image data; determining, by a processor, feature points within at least one image based on the vehicle data and a three dimensional projection method; selecting, by the processor, a subset of the feature points as ground points; determining, by the processor, a ground plane based on the subset of feature points; determining, by the processor, a ground normal vector from the ground plane; determining, by the processor, a camera to ground alignment value based on the ground normal vector; and generating, by the processor, second image data based on the camera to ground alignment value.

Patent Agency Ranking