TIMESTAMP AND METADATA PROCESSING FOR VIDEO COMPRESSION IN AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210195213A1

    公开(公告)日:2021-06-24

    申请号:US16461350

    申请日:2019-04-29

    IPC分类号: H04N19/172 H04N19/46

    摘要: A method to perform video compression for ADV is disclosed. The method receives multiple frames of image data from multiple cameras. Metadata are appended to each frame of the image data to generate one of multiple frames of uncompressed image data as the image data are received. The frames of uncompressed image data may be stored. To compress the image data later, the method retrieves the frames of uncompressed image data, extracts the metadata from each frame of the uncompressed image data to generate one of multiple frames of processed image data. The method compresses each frame of the processed image data with the metadata extracted to generate one of multiple frames of compressed image data. The method reattaches the metadata to a corresponding frame of the compressed image data to generate one of multiple compressed image frames. The metadata supports time synchronization and error handling of the image data.

    MULTIPLE SENSOR DATA STORAGE WITH COMPRESSED VIDEO STREAM IN AUTONOMOUS DRIVING VEHICLES

    公开(公告)号:US20210188310A1

    公开(公告)日:2021-06-24

    申请号:US16461364

    申请日:2019-04-29

    IPC分类号: B60W60/00 G06K9/00

    摘要: An ADV includes a method to combine data from multiple sensors. The method compresses video data from a camera to generate compressed video data. The compressed video data are segmented. The method time synchronizes each segment of the compressed video data with data from other sensors. The method then combines each segment of the compressed video data with the corresponding time-synchronized sensor data for the other sensors. In one embodiment, each segment of the compressed video data is independently decodable. In another embodiment, each segment of the compressed video data includes a compressed video unit that is prepended with a buffered portion of the compressed video data that immediately precede the compressed video unit. The length of the compressed video unit is smaller than the length of the independently decodable segment to offer finer granularity in time synchronizing the compressed video data with the other sensor data with a tradeoff

    OPEN AND SAFE MONITORING SYSTEM FOR AUTONOMOUS DRIVING PLATFORM

    公开(公告)号:US20210021442A1

    公开(公告)日:2021-01-21

    申请号:US16513682

    申请日:2019-07-16

    申请人: Baidu USA LLC

    摘要: In one embodiment, a system for operating an autonomous driving vehicle (ADV) includes a number of modules. These modules include at least a perception module to perceive a driving environment surrounding the ADV and a planning module to plan a path to drive the ADV to navigate the driving environment. The system further includes a bus coupled to the modules and a sensor processing module communicatively coupled to the modules over the bus. The sensor processing module includes a bus interface coupled to the bus, a sensor interface to be coupled to a first set of one or more sensors mounted on the ADV, a message queue to store messages published by the sensors, and a message handler to manage the messages stored in the message queue. The messages may be subscribed by at least one of the modules to allow the modules to monitor operations of the sensors.