TIMESTAMP AND METADATA PROCESSING FOR VIDEO COMPRESSION IN AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210195213A1

    公开(公告)日:2021-06-24

    申请号:US16461350

    申请日:2019-04-29

    IPC分类号: H04N19/172 H04N19/46

    摘要: A method to perform video compression for ADV is disclosed. The method receives multiple frames of image data from multiple cameras. Metadata are appended to each frame of the image data to generate one of multiple frames of uncompressed image data as the image data are received. The frames of uncompressed image data may be stored. To compress the image data later, the method retrieves the frames of uncompressed image data, extracts the metadata from each frame of the uncompressed image data to generate one of multiple frames of processed image data. The method compresses each frame of the processed image data with the metadata extracted to generate one of multiple frames of compressed image data. The method reattaches the metadata to a corresponding frame of the compressed image data to generate one of multiple compressed image frames. The metadata supports time synchronization and error handling of the image data.

    COMMUNICATIONS PROTOCOLS BETWEEN PLANNING AND CONTROL OF AUTONOMOUS DRIVING VEHICLE

    公开(公告)号:US20210191402A1

    公开(公告)日:2021-06-24

    申请号:US16338462

    申请日:2019-03-29

    IPC分类号: G05D1/02 B60R16/023

    摘要: Based on sensor data obtained from a variety of sensors, a driving environment surrounding an autonomous driving vehicle (ADV) is perceived, including perceiving and identifying one or more obstacles. A trajectory is planned based on the perception data according to a set of rules to drive the ADV navigating through the driving environment. Trajectory data representing the trajectory is generated, where the trajectory data includes information indicating target or expected vehicle states at different points in time along the trajectory. The trajectory data is then transmitted in a sequence or a stream of one or more controller area network (CAN) messages to an electronic control unit (ECU) of the ADV over a CAN bus. The ECU is configured to generate and issue one or more control commands (e.g., throttle, brake, steering commands) based on the trajectory data to drive the ADV according to the trajectory.

    MULTIPLE SENSOR DATA STORAGE WITH COMPRESSED VIDEO STREAM IN AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210188310A1

    公开(公告)日:2021-06-24

    申请号:US16461364

    申请日:2019-04-29

    IPC分类号: B60W60/00 G06K9/00

    摘要: An ADV includes a method to combine data from multiple sensors. The method compresses video data from a camera to generate compressed video data. The compressed video data are segmented. The method time synchronizes each segment of the compressed video data with data from other sensors. The method then combines each segment of the compressed video data with the corresponding time-synchronized sensor data for the other sensors. In one embodiment, each segment of the compressed video data is independently decodable. In another embodiment, each segment of the compressed video data includes a compressed video unit that is prepended with a buffered portion of the compressed video data that immediately precede the compressed video unit. The length of the compressed video unit is smaller than the length of the independently decodable segment to offer finer granularity in time synchronizing the compressed video data with the other sensor data with a tradeoff

    A MAP-LESS AND CAMERA-BASED LANE MARKINGS SAMPLING METHOD FOR LEVEL-3 AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210188285A1

    公开(公告)日:2021-06-24

    申请号:US16338447

    申请日:2019-03-28

    发明人: Xin XU Fan ZHU Lin MA

    摘要: A computer-implemented method, apparatus, and system for discretizing lane markings and for generating a lane reference line is disclosed. A polynomial defined over an (x,y) coordinate system is received, the polynomial being representative of at least a portion of a lane boundary line. A length of the polynomial is determined. The polynomial is discretized, comprising determining a plurality of discretization points on the polynomial to represent the polynomial, wherein a first discretization point is a first end of the polynomial, wherein subsequent discretization points are determined successively until the polynomial is completely discretized, and wherein each discretization point other than the first discretization point is determined based at least in part on a slope of the polynomial at a previous discretization point. Thereafter, a lane reference line comprising a plurality of points is generated based on the discretized polynomial.

    DISTRIBUTED AI TRAINING TOPOLOGY BASED ON FLEXIBLE CABLE CONNECTION

    公开(公告)号:US20210174174A1

    公开(公告)日:2021-06-10

    申请号:US16622789

    申请日:2019-11-15

    IPC分类号: G06N3/063 G06F9/50 G06F13/36

    摘要: A data processing system includes a central processing unit (CPU) and accelerator cards coupled to the CPU over a bus, each of the accelerator cards having a plurality of data processing (DP) accelerators to receive DP tasks from the CPU and to perform the received DP tasks. At least two of the accelerator cards are coupled to each other via an inter-card connection, and at least two of the DP accelerators are coupled to each other via an inter-chip connection. Each of the inter-card connection and the inter-chip connection is capable of being dynamically activated or deactivated, such that in response to a request received from the CPU, any one of the accelerator cards or any one of the DP accelerators within any one of the accelerator cards can be enabled or disabled to process any one of the DP tasks received from the CPU.

    Systems and methods for deep localization and segmentation with a 3D semantic map

    公开(公告)号:US11030525B2

    公开(公告)日:2021-06-08

    申请号:US16604548

    申请日:2018-02-09

    摘要: Presented are deep learning-based systems and methods for fusing sensor data, such as camera images, motion sensors (GPS/IMU), and a 3D semantic map to achieve robustness, real-time performance, and accuracy of camera localization and scene parsing useful for applications such as robotic navigation and augment reality. In embodiments, a unified framework accomplishes this by jointly using camera poses and scene semantics in training and testing. To evaluate the presented methods and systems, embodiments use a novel dataset that is created from real scenes and comprises dense 3D semantically labeled point clouds, ground truth camera poses obtained from high-accuracy motion sensors, and pixel-level semantic labels of video camera images. As demonstrated by experimental results, the presented systems and methods are mutually beneficial for both camera poses and scene semantics.

    METHOD FOR OPTIMIZING THREE-POINT TURN OF AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210155237A1

    公开(公告)日:2021-05-27

    申请号:US16693054

    申请日:2019-11-22

    发明人: NING YU FAN ZHU XIN XU

    IPC分类号: B60W30/18 B60W40/105 G06K9/00

    摘要: In one embodiment, it is determined that a speed of an autonomous driving vehicle (ADV) is below a predetermined speed threshold during a current turn section of a three-point turn, where the three-point turn includes at least three turn sections. In response, detecting an obstacle within a predetermined proximity of the ADV, determining a type of obstacle. An amount of time during which the speed of the ADV remains below the predetermined speed threshold is determined. It is determined whether the amount of time is greater than a time threshold corresponding to the type of the obstacle. If the amount of time is greater than the time threshold, the current turn section is ended and a next turn section is started.

    METHOD, APPARATUS, DEVICE, AND STORAGE MEDIUM FOR PERFORMING PROCESSING TASK

    公开(公告)号:US20210072996A1

    公开(公告)日:2021-03-11

    申请号:US16729989

    申请日:2019-12-30

    摘要: Methods, apparatuses, devices, and storage media for performing a processing task are provided. A portion of portions of the processing task can include a group of operations that are to be performed at a processing unit of processing units. The group of operations can include operations of a first type and operations of a second type. In the method, a first queue for performing the operations of the first type and a second queue for performing the operations of the second type can be built, respectively. Based on a definition of the processing task, a dependency relationship between a group of operations to be performed at the processing unit and a group of operations to be performed at other processing units in the plurality of processing units can be obtained. Operations in the first queue and operations in the second queue can be performed respectively based on the dependency relationship.

    Method and apparatus for determining a vehicle control parameter, vehicle on-board controller and autonomous vehicle

    公开(公告)号:US10942521B2

    公开(公告)日:2021-03-09

    申请号:US16265775

    申请日:2019-02-01

    发明人: Fan Zhu Lin Ma Qi Kong

    摘要: Embodiments of the present disclosure disclose a method for determining a vehicle control parameter, an apparatus for the same, a vehicle controller, and an autonomous vehicle. An embodiment of the method comprises: determining a current vehicle speed and an expected acceleration; determining, from a pre-generated parameter calibration table, a longitudinal control parameter corresponding to the current vehicle speed and the expected acceleration; wherein the parameter calibration table is obtained by: obtaining a training sample set, a training sample in the training sample set including the vehicle speed, the longitudinal control parameter and the acceleration; training a pre-established parameter calibration model with the vehicle speed and acceleration of respective samples in the training sample set as inputs and the longitudinal control parameter value in the training sample as an expected output; and obtaining the parameter calibration table based on the trained parameter calibration model.