公开(公告)号：US20240312219A1

公开(公告)日：2024-09-19

申请号：US18185074

申请日：2023-03-16

Applicant: NVIDIA Corporation

Inventor： Jiwoong Choi ,  Jose Manuel Alvarez Lopez ,  Shiyi Lan ,  Yashar Asgarieh ,  Zhiding Yu

IPC: G06V20/58 ,  B60W60/00

CPC classification number: G06V20/58 ,  B60W60/001 ,  B60W2420/403

Abstract: In various examples, temporal-based perception for autonomous or semi-autonomous systems and applications is described. Systems and methods are disclosed that use a machine learning model (MLM) to intrinsically fuse feature maps associated with different sensors and different instances in time. To generate a feature map, image data generated using image sensors (e.g., cameras) located around a vehicle are processed using a MLM that is trained to generate the feature map. The MLM may then fuse the feature maps in order to generate a final feature map associated with a current instance in time. The feature maps associated with the previous instances in time may be preprocessed using one or more layers of the MLM, where the one or more layers are associated with performing temporal transformation before the fusion is performed. The MLM may then use the final feature map to generate one or more outputs.