-
公开(公告)号:US20240185587A1
公开(公告)日:2024-06-06
申请号:US18556636
申请日:2021-08-16
发明人: Haofeng KOU , Xing LI , Huimeng ZHENG , Lei WANG , Zhen CHEN
IPC分类号: G06V10/776 , G06V10/82 , G06V10/94
CPC分类号: G06V10/776 , G06V10/82 , G06V10/955
摘要: Modem deep neural network (DNN) models have many layers with a single layer potentially involving large matrix multiplications. Such heavy calculation brings challenges to deploy such DNN models on a single edge device, which has relatively limited computation resources. Therefore, multiple and even heterogeneous edge devices may be required for applications with stringent latency requirements. Disclosed in the present patent documents are embodiments of a model scheduling framework that schedules multiple models on a heterogeneous platform. Two different approaches, model first scheduling (MFS) and hardware first scheduling (HFS), are presented to allocate a group of models for a service into corresponding heterogeneous edge devices, including CPU, VPU and GPU. Experimental results prove the effectiveness of the MFS and HFS methods for improving the inference speed of single and multiple AI-based services.
-
公开(公告)号:US20240185386A1
公开(公告)日:2024-06-06
申请号:US18556653
申请日:2021-09-30
发明人: Zhihong PAN , Baopu LI , Dongliang HE , Wenhao WU , Tianwei LIN
IPC分类号: G06T3/4076 , G06T3/4046
CPC分类号: G06T3/4076 , G06T3/4046
摘要: Image super-resolution (SR) refers to the process of recovering high-resolution (HR) images from low-resolution (LR) inputs. Blind image SR is a more challenging task which involves unknown blurring kernels and characterizes the degradation process from HR to LR. In the present disclosure, embodiments of a variational autoencoder (VAE) are leveraged to train a kernel autoencoder for more accurate degradation representation and more efficient kernel estimation. In one or more embodiments, a kernel-agnostic loss is used to learn more robust kernel features in the latent space from LR inputs without using ground-truth kernel references. In addition, attention-based adaptive pooling is introduced to improve kernel estimation accuracy, and spatially non-uniform kernel features are passed into SR restoration resulting in additional kernel estimation error tolerance. Extensive experiments on synthetic and real-world images show that embodiments of the presented model outperform state-of-the-art methods significantly with the peak signal-to-noise ratio (PSNR) raised considerably.
-
公开(公告)号:US11807265B2
公开(公告)日:2023-11-07
申请号:US16494735
申请日:2019-08-30
发明人: Shuai Wang , Manjiang Zhang , Yaoming Shen , Lingchang Li , Shuangcheng Guo
CPC分类号: B60W60/001 , G06V20/588 , B60W2420/42 , B60W2552/53
摘要: In some implementations, a method is provided. The method includes determining a first set of data acquisition characteristics of a first sensor of an autonomous driving vehicle. The method also includes determining a second set of data acquisition characteristics of a second sensor of the autonomous driving vehicle. The method further includes synchronizing a first data acquisition time of the first sensor and a second data acquisition time of the second sensor, based on the first set of data acquisition characteristics and the second set of data acquisition characteristics. The first sensor obtains first sensor data at the first data acquisition time. The second sensor obtains second sensor data at the second data acquisition time.
-
84.
公开(公告)号:US11772681B2
公开(公告)日:2023-10-03
申请号:US17463501
申请日:2021-08-31
发明人: Shengjian Guo , Zhisheng Hu , Zhenyu Zhong , Kang Li
CPC分类号: B60W60/001 , B60W50/0098 , G07C5/04 , H04L65/61 , B60W2050/0022 , B60W2556/35 , B60W2556/45
摘要: A method for processing autonomous driving simulation data. The method includes: determining a type of a message transmitted between a simulation system and an auto driving system (ADS); determining a data acquisition mode based on the type of the message; obtaining a data stream transmitted between the simulation system and the ADS based on the data acquisition mode; and determining performance of the ADS based on the data stream.
-
公开(公告)号:US11758088B2
公开(公告)日:2023-09-12
申请号:US16703075
申请日:2019-12-04
发明人: Hao Tian , Xi Chen , Jeff ChienYu Wang , Daming Lu
摘要: Embodiments of the present disclosure provide a method and apparatus for aligning a paragraph and a video. The method may include: acquiring a commentary and a candidate material resource set corresponding to the commentary, a candidate material resource being a video or an image; acquiring a matching degree between each paragraph in the commentary and each candidate material resource in the candidate material resource set; and determining a candidate material resource sequence corresponding to the each paragraph in the commentary based on the matching degrees between the paragraphs in the commentary and the candidate material resources, playing durations of the candidate material resources and text lengths of the paragraphs in the commentary, an image playing duration being a preset image playing duration.
-
公开(公告)号:US11724708B2
公开(公告)日:2023-08-15
申请号:US16960843
申请日:2020-06-12
发明人: Guohao Gong , Fan Zhu , Yue Wang , Xin Xu , Xiang Liu , Yongyi Sun , Yingnan Liu , Junping Wang , Jingjing Xue
IPC分类号: B60W50/023 , B60W60/00 , B60W10/18 , B60W30/06 , B60W50/02
CPC分类号: B60W50/023 , B60W10/18 , B60W30/06 , B60W50/0205 , B60W50/0225 , B60W60/001
摘要: According to various embodiment, described herein are methods and systems for reliably detecting malfunctions in a variety of software or hardware components in an autonomous driving vehicle (ADV). In one embodiment, a redundant system can be provided on an independent computing device in an ADV to check for malfunctions in a number of software or hardware components. When no malfunction occurs in the ADV, an autonomous driving system (ADS) in the ADV operates to drive the ADV, while the redundant system can monitor the ADS in a standby mode. In the event of a malfunction, the redundant system can take over the control of the ADV, and take appropriate actions based on a severity level of the malfunction.
-
公开(公告)号:US11713057B2
公开(公告)日:2023-08-01
申请号:US16646958
申请日:2020-01-23
CPC分类号: B60W60/0018 , B60W10/20 , B60W50/06 , B60W50/10 , B60W2520/06 , B60W2520/10 , B60W2552/15 , B60W2554/4049 , B60W2555/20
摘要: A lateral control error of a steering system of an ADV is determined, which includes iteratively performing following operations for a predetermined time period. Whether the ADV is moving within a predetermined proximity of a current moving direction is determined. Next, whether a road condition of a road on which the ADV is driving satisfies a predetermined road condition is determined. Then, a first steering feedback of the ADV in response to a prior steering control command is measured. Thereafter, the lateral control error is determined based on at least a portion of the first steering feedback over the predetermined time period. Further, a steering command in view of the lateral control error of the steering system is generated. Finally, the steering command is applied to control the ADV to compensate the lateral control error of the steering system.
-
公开(公告)号:US11703599B2
公开(公告)日:2023-07-18
申请号:US16771312
申请日:2020-05-15
IPC分类号: G01S17/931 , G06T7/20 , G01S17/42 , G01S7/48 , G01S17/58 , B60W60/00 , G01S17/00 , G06V10/25 , G06V20/10 , G06V20/56
CPC分类号: G01S17/931 , B60W60/0011 , G01S7/4802 , G01S17/00 , G01S17/42 , G01S17/58 , G06T7/20 , G06V10/25 , G06V20/10 , G06V20/56 , B60W2420/52 , B60W2554/4029 , G06T2207/10028 , G06T2207/30196 , G06T2207/30241 , G06T2207/30252
摘要: A method, apparatus, and system for estimating a moving speed of a detected pedestrian at an autonomous driving vehicle (ADV) is disclosed. A pedestrian is detected in a plurality of frames of point clouds generated by a LIDAR device installed at an autonomous driving vehicle (ADV). In each of at least two of the plurality of frames of point clouds, a minimum bounding box enclosing points corresponding to the pedestrian excluding points corresponding to limbs of the pedestrian is generated. A moving speed of the pedestrian is estimated based at least in part on the minimum bounding boxes across the at least two of the plurality of frames of point clouds. A trajectory for the ADV is planned based at least on the moving speed of the pedestrian. Thereafter, control signals are generated to drive the ADV based on the planned trajectory.
-
公开(公告)号:US11693970B2
公开(公告)日:2023-07-04
申请号:US16315957
申请日:2019-01-04
申请人: Baidu USA LLC , Baidu.com Times Technology (Beijing) Co., Ltd. , KUNLUNXIN TECHNOLOGY (BEIJING) COMPANY LIMITED
发明人: Yong Liu , Yueqiang Cheng , Jian Ouyang , Tao Wei
CPC分类号: G06F21/575 , G06F9/5027 , G06F21/53
摘要: According to one embodiment, a system performs a secure boot using a security module such as a trusted platform module (TPM) of a host system. The system establishes a trusted execution environment (TEE) associated with one or more processors of the host system. The system launches a memory manager within the TEE, where the memory manager is configured to manage memory resources of a data processing (DP) accelerator coupled to the host system over a bus, including maintaining memory usage information of global memory of the DP accelerator. In response to a request received from an application running within the TEE for accessing a memory location of the DP accelerator, the system allows or denies the request based on the memory usage information.
-
公开(公告)号:US11662745B2
公开(公告)日:2023-05-30
申请号:US16757894
申请日:2020-03-26
发明人: Quanwei Liu , Yan Cui , Zhuo Yao
CPC分类号: G05D1/0278 , G05D1/0088 , G05D1/0221 , H04J3/0652
摘要: In one embodiment, a method for synchronizing sensor data of an autonomous driving vehicle includes determining, by a processing device of an inertial navigation system (INS), that global navigation satellite system (GNSS) data is unavailable and identifying an alternative source of time information. The method further includes retrieving time information from the alternative source and synchronizing sensor data with the time information from the alternative source of time information.
-
-
-
-
-
-
-
-
-