-
公开(公告)号:US20250069184A1
公开(公告)日:2025-02-27
申请号:US18454940
申请日:2023-08-24
Applicant: QUALCOMM Incorporated
Inventor: Varun Ravi Kumar , Risheek Garrepalli , Senthil Kumar Yogamani
Abstract: A method of processing image content includes constructing a first graph representation having a first level of point sparsity from a first point cloud data, and performing diffusion-based upsampling on the first graph representation to generate a second graph representation having a second level of point sparsity. Performing diffusion-based upsampling includes inputting the first graph representation into a diffusion-based trained model to generate a first intermediate graph representation having a first intermediate level of point sparsity, inputting the first intermediate graph representation into the diffusion-based trained model to generate a second intermediate graph representation having a second intermediate level of point sparsity, and generating the second graph representation based on at least on the second intermediate graph representation. The method includes generating second point cloud data having the second level of point sparsity based on the second graph representation having the second level of point sparsity.
-
公开(公告)号:US20240425042A1
公开(公告)日:2024-12-26
申请号:US18340361
申请日:2023-06-23
Applicant: QUALCOMM Incorporated
Inventor: Ming-Yuan Yu , Varun Ravi Kumar , Senthil Kumar Yogamani
IPC: B60W30/095 , G06T7/10 , G06T7/246 , G08G1/16
Abstract: A system for navigation store, in a time-based buffer, a first set of frames acquired by a sensor; stores, in a distance-based buffer, a second set of frames acquired by the sensor, performs moving object segmentation on the first set of frames and the second set of frames to identify at least one moving object in a scene of the frames; predicts a trajectory of the at least one moving object; and performs a navigation function based on the predicted trajectory.
-
公开(公告)号:US20240378872A1
公开(公告)日:2024-11-14
申请号:US18314607
申请日:2023-05-09
Applicant: QUALCOMM Incorporated
Inventor: Nirnai Ach , Mireille Lucette Laure Gregoire , Julia Kabalar , Senthil Kumar Yogamani
IPC: G06V10/80 , G01C21/16 , G06V10/774 , G06V10/82 , G06V20/58
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method of image processing includes receiving first kinematic information associated with a camera image sensor; receiving, by the processor, point cloud data from a light detection and ranging (LiDAR) sensor; generating, by the processor, first image data that is time-synchronized with the point cloud data based on the first kinematic information and a neural radiance fields (NeRF) model; and generating, by the processor, fused data that combines the first image data and the point cloud data. Other aspects and features are also claimed and described.
-
14.
公开(公告)号:US20240249527A1
公开(公告)日:2024-07-25
申请号:US18158990
申请日:2023-01-24
Applicant: QUALCOMM Incorporated
CPC classification number: G06V20/56 , G06T3/4053 , G06T7/60 , G06T9/00 , G06T17/00 , G06V10/70 , G06T2207/20081 , G06T2207/30252
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method is provided that includes receiving sensor data from a plurality of sensors on a vehicle and determining a three-dimensional representation of an area surrounding the vehicle by mapping the sensor data onto a three-dimensional surface. The plurality of sensors may include at least one perspective view sensor and at least one top view sensor, and the three-dimensional surface may include sensor data from the at least one perspective view sensor and sensor data from the at least one top view sensor. The method may further include determining, with a machine learning model, one or more characteristics of the area surrounding the vehicle based on the three-dimensional representation. Other aspects and features are also claimed and described.
-
15.
公开(公告)号:US20250095329A1
公开(公告)日:2025-03-20
申请号:US18469863
申请日:2023-09-19
Applicant: QUALCOMM Incorporated
Inventor: Kiran Bangalore Ravi , Julia Kabalar , Nirnai Ach , Mireille Lucette Laure Gregoire , Senthil Kumar Yogamani
Abstract: A device for processing sensor data is configured to receive the first frames from a first sensor; receive the second frames from a second sensor; perform a first feature extraction on the first frames using a first dynamic neural network to determine first features; perform a second feature extraction on the second frames using a second dynamic neural network to determine second features; determine a first delay associated with the first features; determine a second delay associated with the second features; modify a topology of the second dynamic neural network based on the first delay and the second delay; and use the second dynamic neural network with the modified topology to generate an output.
-
公开(公告)号:US20250060481A1
公开(公告)日:2025-02-20
申请号:US18452279
申请日:2023-08-18
Applicant: QUALCOMM Incorporated
Inventor: Meysam Sadeghigooghari , Varun Ravi Kumar , Senthil Kumar Yogamani
Abstract: An apparatus includes a memory and processing circuitry in communication with the memory. The processing circuitry is configured to apply, based on a positional encoding model, a first feature conditioning module to a set of bird's eye view (BEV) position data features corresponding to position data to generate a set of conditioned BEV position data features, and apply, based on the position encoding model, a second feature conditioning module to a set of perspective image data features corresponding to image data to generate a set of conditioned perspective image data features. The processing circuitry is also configured to generate, based on the positional encoding model, the set of conditioned BEV position data features, and the set of conditioned perspective image data features, a weighted summation. Additionally, the processing circuitry is configured to generate, based on the weighted summation, a set of BEV image data features.
-
公开(公告)号:US20250058789A1
公开(公告)日:2025-02-20
申请号:US18452292
申请日:2023-08-18
Applicant: QUALCOMM Incorporated
Abstract: A system for processing image data and position data, the system comprising: a memory for storing the image data and the position data; and processing circuitry in communication with the memory. The processing circuitry is configured to: apply a first encoder to extract, from the image data, a first set of features; apply a first decoder to determine, based on the first set of features, a first uncertainty score. Additionally, the processing circuitry is configured to apply a second encoder to extract, from the position data, a second set of features; apply a second decoder to determine, based on the second set of features, a second uncertainty score; and fuse the first set of features and the second set of features based on the first uncertainty score and the second uncertainty score.
-
公开(公告)号:US20240395007A1
公开(公告)日:2024-11-28
申请号:US18321520
申请日:2023-05-22
Applicant: QUALCOMM Incorporated
Inventor: Varun Ravi Kumar , Debasmit Das , Senthil Kumar Yogamani
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method of image processing includes receiving a plurality of image frames by a computing device and using machine learning models to identify corrupted or occluded image frames. A first machine learning model may identify corrupted image frames, while a second machine learning model may identify partially occluded image frames. The method may further include generating updated versions of image frames captured by vehicle cameras, such as based on feature vectors from the first and second machine learning models. The feature vectors may be fused and provided to a third machine learning model to generate updated versions of occluded image frames. The method may further include determining vehicle control instructions based on the updated versions. Other aspects and features are also claimed and described.
-
公开(公告)号:US20240371168A1
公开(公告)日:2024-11-07
申请号:US18311784
申请日:2023-05-03
Applicant: QUALCOMM Incorporated
Inventor: Deeksha Dixit , Varun Ravi Kumar , Senthil Kumar Yogamani
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method is provided that includes generating a top view image of an object using a plurality of images captured from different views. The method involves determining portions of the images that depict the object and generating novel views of the object from at least one novel view not present within the plurality of images. Corresponding portions containing an occluded view and an unobstructed view of the object are identified and corrected views for occluded views are determined based on corresponding unobstructed views using a machine learning model. A top view image may be then generated based on the corrected views. The invention enables improved visibility for autonomous driving systems in situations where objects are occluded or partially obstructed. Other aspects and features are also claimed and described.
-
公开(公告)号:US20240371147A1
公开(公告)日:2024-11-07
申请号:US18313287
申请日:2023-05-05
Applicant: QUALCOMM Incorporated
Inventor: Varun Ravi Kumar , Senthil Kumar Yogamani
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a method of fusing features from near-field images and far-field images is provided that includes determining feature vectors and spatial locations for received images from near-field and far-field image sensors. A first set of weighted feature vectors may be determined based on spatial locations of the features and a second set of weighted feature vectors may be determined based on corresponding features between the feature vectors. Fused feature vectors may then be determined based on the weighted feature vectors, such as using a transformer attention process trained to select and combine features from both sets of weighted feature vectors. Vehicle control instructions may be determined based on the fused feature vectors. Other aspects and features are also claimed and described.
-
-
-
-
-
-
-
-
-