公开(公告)号：US12110013B2

公开(公告)日：2024-10-08

申请号：US17961885

申请日：2022-10-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Oded Bialer ,  Siddhartha Gupta

IPC: B60W30/00 ,  B60W30/095 ,  G01S7/41 ,  G01S13/52 ,  G01S13/86 ,  G01S13/931

CPC classification number: B60W30/0956 ,  G01S7/415 ,  G01S13/52 ,  G01S13/867 ,  G01S13/931 ,  B60W2420/403 ,  B60W2420/408 ,  B60W2554/4029 ,  B60W2554/4044 ,  B60W2554/4045 ,  B60W2554/801 ,  B60W2556/40 ,  B60W2720/106 ,  B60W2720/24 ,  G01S2013/9318 ,  G01S2013/93185

Abstract: A system of controlling operation of a vehicle includes one or more sensors operatively connected to the vehicle. The sensors are configured to obtain respective data of a scene and include a radar unit. A command unit is adapted to receive the respective data and includes a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is configured to determine an orientation angle of a pedestrian in the scene, a Doppler frequency of the pedestrian and a distance of the pedestrian from a border of a road, based in part on the respective data. The orientation angle is based on a heading of the pedestrian relative to a direction of a road. The command unit is configured to designate a status of the pedestrian as either crossing or not crossing based on the distance, the orientation angle and the Doppler frequency of the pedestrian.

公开(公告)号：US12243295B2

公开(公告)日：2025-03-04

申请号：US17709553

申请日：2022-03-31

Applicant: GM Global Technology Operations LLC

Inventor： Wei Tong ,  Jacob Alan Bond ,  Siddhartha Gupta

IPC: G06V10/774 ,  G06N3/08 ,  G06V10/82

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to: receive intermediate concept constraints at a neural network and train the neural network with training data, training labels, and the at least one of the data constraint, the feature constraint, or the intermediate concept constraint.

公开(公告)号：US12175732B2

公开(公告)日：2024-12-24

申请号：US17817704

申请日：2022-08-05

Applicant: GM Global Technology Operations LLC

Inventor： Siddhartha Gupta ,  Wei Tong ,  Upali P. Mudalige

IPC: G06V10/778 ,  G06T7/11 ,  G06V10/25 ,  G06V10/26 ,  G06V10/74 ,  G06V10/774

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to determine a pairwise region of interest feature similarity based on features extracted from a first cropped image portion and corresponding point cloud data and features extracted from a second cropped image portion and corresponding point cloud data. The processor is also programmed to determine a loss using a loss function based on the pairwise region of interest feature similarity, wherein the loss function corresponds to at least one a first deep neural network or a second deep neural network. The processor is also programmed to update at least one weight of the at least one of the first deep neural network or the second deep neural network based on the loss.

公开(公告)号：US20240092359A1

公开(公告)日：2024-03-21

申请号：US17946343

申请日：2022-09-16

Applicant: GM Global Technology Operations LLC

Inventor： Oded Bialer ,  Siddhartha Gupta

IPC: B60W30/095 ,  B60W30/09 ,  B60W60/00 ,  G06T7/246 ,  G06T7/277 ,  G06T7/73 ,  G06V10/764 ,  G06V10/82 ,  G06V20/40 ,  G06V20/58 ,  G06V40/10 ,  G06V40/20 ,  G08G1/16

CPC classification number: B60W30/0956 ,  B60W30/09 ,  B60W60/0015 ,  G06T7/251 ,  G06T7/277 ,  G06T7/75 ,  G06V10/764 ,  G06V10/82 ,  G06V20/41 ,  G06V20/46 ,  G06V20/58 ,  G06V40/10 ,  G06V40/20 ,  G08G1/166 ,  B60W2420/42 ,  B60W2554/4029 ,  G06T2207/10016 ,  G06T2207/20084 ,  G06T2207/30196 ,  G06T2207/30241 ,  G06T2207/30261

Abstract: A system in a vehicle includes a camera to obtain video in a field of view over a number of frames and a controller to process the video to identify one or more pedestrians. The controller also implements a neural network to provide a classification of a motion of each pedestrian among a set of classifications of pedestrian motion. Each classification among the set of classifications indicates initiation of the motion or no change in the motion. The controller predicts a trajectory for each pedestrian based on the classification of the motion, and controls operation of the vehicle based on the trajectory predicted for each pedestrian.

公开(公告)号：US20240046627A1

公开(公告)日：2024-02-08

申请号：US17817704

申请日：2022-08-05

Applicant: GM Global Technology Operations LLC

Inventor： Siddhartha Gupta ,  Wei Tong ,  Upali P. Mudalige

IPC: G06V10/778 ,  G06V10/74 ,  G06V10/25 ,  G06T7/11 ,  G06V10/26 ,  G06V10/774

CPC classification number: G06V10/778 ,  G06V10/761 ,  G06V10/25 ,  G06T7/11 ,  G06V10/26 ,  G06V10/774 ,  G06T2207/20132 ,  G06T2207/20084 ,  G06T2207/20081 ,  G06T2207/10024

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to determine a pairwise region of interest feature similarity based on features extracted from a first cropped image portion and corresponding point cloud data and features extracted from a second cropped image portion and corresponding point cloud data. The processor is also programmed to determine a loss using a loss function based on the pairwise region of interest feature similarity, wherein the loss function corresponds to at least one a first deep neural network or a second deep neural network. The processor is also programmed to update at least one weight of the at least one of the first deep neural network or the second deep neural network based on the loss.

公开(公告)号：US20230316728A1

公开(公告)日：2023-10-05

申请号：US17709553

申请日：2022-03-31

Applicant: GM Global Technology Operations LLC

Inventor： Wei Tong ,  Jacob Alan Bond ,  Siddhartha Gupta

IPC: G06V10/774 ,  G06N3/08 ,  G06V10/82

CPC classification number: G06V10/7747 ,  G06N3/08 ,  G06V10/82

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to: receive intermediate concept constraints at a neural network and train the neural network with training data, training labels, and the at least one of the data constraint, the feature constraint, or the intermediate concept constraint.

公开(公告)号：US20240116503A1

公开(公告)日：2024-04-11

申请号：US17961885

申请日：2022-10-07

Applicant: GM Global Technology Operations LLC

Inventor： Oded Bialer ,  Siddhartha Gupta

IPC: B60W30/095 ,  G01S7/41 ,  G01S13/52 ,  G01S13/86 ,  G01S13/931

CPC classification number: B60W30/0956 ,  G01S7/415 ,  G01S13/52 ,  G01S13/867 ,  G01S13/931 ,  B60W2420/42 ,  B60W2420/52 ,  B60W2554/4029 ,  B60W2554/4044 ,  B60W2554/4045 ,  B60W2554/801 ,  B60W2556/40 ,  B60W2720/106 ,  B60W2720/24 ,  G01S2013/9318 ,  G01S2013/93185

Abstract: A system of controlling operation of a vehicle includes one or more sensors operatively connected to the vehicle. The sensors are configured to obtain respective data of a scene and include a radar unit. A command unit is adapted to receive the respective data and includes a processor and tangible, non-transitory memory on which instructions are recorded. The command unit is configured to determine an orientation angle of a pedestrian in the scene, a Doppler frequency of the pedestrian and a distance of the pedestrian from a border of a road, based in part on the respective data. The orientation angle is based on a heading of the pedestrian relative to a direction of a road. The command unit is configured to designate a status of the pedestrian as either crossing or not crossing based on the distance, the orientation angle and the Doppler frequency of the pedestrian.

公开(公告)号：US11954916B2

公开(公告)日：2024-04-09

申请号：US17665895

申请日：2022-02-07

Applicant: GM Global Technology Operations LLC

Inventor： Wei Tong ,  Siddhartha Gupta ,  Jacob Alan Bond ,  Zhuoning Yuan

IPC: G06V20/00 ,  B60W40/04 ,  B60W60/00 ,  G06V10/40 ,  G06V10/74 ,  G06V10/764 ,  G06V10/82 ,  G06V20/58

CPC classification number: G06V20/58 ,  B60W40/04 ,  B60W60/001 ,  G06V10/40 ,  G06V10/761 ,  G06V10/764 ,  G06V10/82 ,  B60W2420/403 ,  B60W2554/4026 ,  B60W2554/4029

Abstract: An automated driving system includes an object detection system. A neural network image encoder generates image embeddings associated with an image including an object. A neural network text encoder generates concept embeddings associated with each of a plurality of concepts. Each of the plurality of concepts is associated with one of at least two object classes. A confidence score module generates a confidence score for each of the plurality of concepts based on the image embeddings and the concept embeddings associated with the concept. An object class prediction module generates a predicted object class of the object based on an association between a set of concepts of the plurality of concepts having at least two of the highest values of the generated confidence scores and the one of the at least two object classes associated with a majority of the set of concepts.

公开(公告)号：US20230252795A1

公开(公告)日：2023-08-10

申请号：US17665895

申请日：2022-02-07

Applicant: GM Global Technology Operations LLC

Inventor： Wei Tong ,  Siddhartha Gupta ,  Jacob Alan Bond ,  Zhuoning Yuan

IPC: G06V20/58 ,  G06V10/82 ,  G06V10/764 ,  G06V10/40 ,  G06V10/74 ,  B60W60/00 ,  B60W40/04

CPC classification number: G06V20/58 ,  G06V10/82 ,  G06V10/764 ,  G06V10/40 ,  G06V10/761 ,  B60W60/001 ,  B60W40/04 ,  B60W2554/4026 ,  B60W2554/4029 ,  B60W2420/42

Abstract: An automated driving system includes an object detection system. A neural network image encoder generates image embeddings associated with an image including an object. A neural network text encoder generates concept embeddings associated with each of a plurality of concepts. Each of the plurality of concepts is associated with one of at least two object classes. A confidence score module generates a confidence score for each of the plurality of concepts based on the image embeddings and the concept embeddings associated with the concept. An object class prediction module generates a predicted object class of the object based on an association between a set of concepts of the plurality of concepts having at least two of the highest values of the generated confidence scores and the one of the at least two object classes associated with a majority of the set of concepts.

公开(公告)号：US20230162039A1

公开(公告)日：2023-05-25

申请号：US17535129

申请日：2021-11-24

Applicant: GM Global Technology Operations LLC

Inventor： Siddhartha Gupta ,  Jacob Alan Bond ,  Wei Tong ,  Upali P. Mudalige

IPC: G06N3/08 ,  G06V10/75 ,  G06V10/82

CPC classification number: G06N3/084 ,  G06V10/751 ,  G06V10/82

Abstract: A system comprises a computer including a processor and a memory. The memory includes instructions such that the processor is programmed to: receive, at a selective dropout layer of a neural network, a plurality of adversarial image features and a plurality of natural image features, select one or more nodes within the selective dropout layer to deactivate based on a comparison of the plurality of adversarial image features with the plurality of natural image features, and deactivate the selected one or more nodes.