-
公开(公告)号:US20240354979A1
公开(公告)日:2024-10-24
申请号:US18435458
申请日:2024-02-07
Applicant: QUALCOMM Incorporated
Inventor: Sai Madhuraj Jadhav , Amin Ansari , Yunxiao Shi
CPC classification number: G06T7/55 , G06T7/70 , G06T11/00 , G06T2207/20081 , G06T2207/20212 , G06T2207/30244
Abstract: This disclosure provides systems, methods, and devices for image signal processing that support multi-source pose merging for depth estimation. In a first aspect, a method of image processing includes generating, in accordance with first image data of a first image frame and second image data of a second image frame, a first mask indicating one or more pixels determined not to change position between the first image frame and the second image frame, generating, in accordance with the first image data and the second image data, a second mask indicating one or more pixels determined not to change position between the first image frame and the second image frame, and combining the first mask with the second mask to generate a third mask. Other aspects and features are also claimed and described.
-
公开(公告)号:US20240221194A1
公开(公告)日:2024-07-04
申请号:US18148816
申请日:2022-12-30
Applicant: QUALCOMM Incorporated
Inventor: Amin Ansari , Yunxiao Shi , Sai Madhuraj Jadhav , Avdhut Joshi
CPC classification number: G06T7/50 , G06T7/11 , G06T2207/30252
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a computing device receives a predicted depth map determined by a model and determines differences between the predicted depth map and a depth mask. The depth mask may be predetermined to include values indicating a probability that a corresponding region of the predicted depth map is a sky region. A first loss term for the predicted depth map is determined based on the differences and the model is trained based on the first loss term. Other aspects and features are also claimed and described.
-
3.
公开(公告)号:US20240371169A1
公开(公告)日:2024-11-07
申请号:US18463040
申请日:2023-09-07
Applicant: QUALCOMM Incorporated
Inventor: Amin Ansari , Sai Madhuraj Jadhav , Yunxiao Shi
Abstract: An example device for processing image data includes a memory configured to store image data; and a processing system comprising one or more processors implemented in circuitry, the processing system being configured to: obtain an image to be processed; obtain a first auxiliary value for the image and a second auxiliary value for the image; generate an input component including the first auxiliary value and the second auxiliary value arranged in a pattern according to a stride of a neural network; and provide the image and the input component to the neural network.
-
公开(公告)号:US20240362807A1
公开(公告)日:2024-10-31
申请号:US18309444
申请日:2023-04-28
Applicant: QUALCOMM Incorporated
Inventor: Yunxiao Shi , Amin Ansari , Sai Madhuraj Jadhav , Avdhut Joshi
CPC classification number: G06T7/55 , G06T7/254 , G06T2207/20084 , G06T2207/30252
Abstract: An example device for processing image data includes a processing unit configured to: receive, from a camera of a vehicle, a first image frame at a first time and a second image frame at a second time; receive, from an odometry unit of the vehicle, a first position of the vehicle at the first time and a second position of the vehicle at a second time; calculate a pose difference value representing a difference between the second and first positions; form a pose frame having a size corresponding to the first and second image frames and sample values including the pose difference value; and provide the first and second image frames and the pose frame to a neural networking unit configured to calculate depth for objects in the first image frame and the second image frame, the depth for the objects representing distances between the objects and the vehicle.
-
公开(公告)号:US20240371035A1
公开(公告)日:2024-11-07
申请号:US18310132
申请日:2023-05-01
Applicant: QUALCOMM Incorporated
Inventor: Sai Madhuraj Jadhav , Amin Ansari , Avdhut Joshi
IPC: G06T7/80 , G01S7/497 , G01S17/86 , G01S17/89 , G01S17/931 , G06T5/00 , G06T5/20 , G06T7/13 , G06T7/521 , H04N17/00
Abstract: A processing system for cross-sensor calibration is configured to perform a first edge detection process on a camera image to generate an edge detected camera image, and perform a second edge detection process on a point cloud frame to generate an edge detected point cloud frame. The processing system projects the edge detected point cloud frame onto the edge detected camera image using an initial calibration matrix, determines an objective function representing an overlap of points in the edge detected point cloud frame and corresponding edge pixel values in the edge detected camera image, and determines a final calibration matrix based on the objective function.
-
公开(公告)号:US20240367674A1
公开(公告)日:2024-11-07
申请号:US18310403
申请日:2023-05-01
Applicant: QUALCOMM Incorporated
Inventor: Sai Madhuraj Jadhav , Amin Ansari , Yunxiao Shi , Avdhut Joshi
Abstract: Example systems and techniques are described for controlling operation of a vehicle and training a machine learning model for controlling operation of a vehicle. A system includes memory configured to store point cloud data associated with the vehicle and one or more processors communicatively coupled to the memory. The one or more processors are configured to determine a depth map indicative of distance of one or more objects to the vehicle and control operation of a vehicle based on the depth map. The depth map is based on executing a machine learning model, the machine learning model being trained with a slice loss function determined from training point cloud data having a respective depth that is greater than the average depth for a set of points of the point cloud data plus a threshold.
-
公开(公告)号:US20240202949A1
公开(公告)日:2024-06-20
申请号:US18067183
申请日:2022-12-16
Applicant: QUALCOMM Incorporated
Inventor: Amin Ansari , Sai Madhuraj Jadhav , Yunxiao Shi , Gautam Sachdeva , Avdhut Joshi
IPC: G06T7/55 , G01S7/4865 , G01S7/4915 , G01S17/89 , G01S17/931
CPC classification number: G06T7/55 , G01S7/4865 , G01S7/4915 , G01S17/89 , G01S17/931 , G06T2207/10028 , G06T2207/20081 , G06T2207/30252
Abstract: This disclosure provides systems, methods, and devices for vehicle driving assistance systems that support image processing. In a first aspect, a computing device may receive a predicted depth map and a measured depth map and may determine a time difference between the predicted depth map and the measured depth map. A supervision loss term may be determined based on the time difference, such as by weighting the supervision loss term based on the time difference. The computing device may train a model based on the supervision loss term, such as a model that generated the predicted depth map. Other aspects and features are also claimed and described.
-
-
-
-
-
-