公开(公告)号：US20240317263A1

公开(公告)日：2024-09-26

申请号：US18680378

申请日：2024-05-31

Applicant: NVIDIA CORPORATION

Inventor： Ahyun SEO ,  Tae Eun Choe ,  Minwoo Park ,  Jung Seock Joo

IPC: B60W60/00 ,  G06N3/04

CPC classification number: B60W60/0015 ,  G06N3/04

Abstract: Systems and methods are disclosed relating to viewpoint adapted perception for autonomous machines and applications. A 3D perception network may be adapted to handle unavailable target rig data by training one or more layers of the 3D perception network as part of a training network using real source rig data and simulated source and target rig data. Feature statistics extracted from the real source data may be used to transform the features extracted from the simulated data during training. The paths for real and simulated data through the resulting network may be alternately trained on real and simulated data to update shared weights for the different paths. As such, one or more of the paths through the training network(s) may be designated as the 3D perception network, and target rig data may be applied to the 3D perception network to perform one or more perception tasks.

公开(公告)号：US20240320923A1

公开(公告)日：2024-09-26

申请号：US18680454

申请日：2024-05-31

Applicant: NVIDIA CORPORATION

Inventor： Ahyun SEO ,  Tae Eun Choe ,  Minwoo Park ,  Jung Seock Joo

IPC: G06T19/00 ,  H04N13/111 ,  H04N13/282

CPC classification number: G06T19/003 ,  H04N13/111 ,  H04N13/282

Abstract: Systems and methods are disclosed relating to viewpoint adapted perception for autonomous machines and applications. A 3D perception network may be adapted to handle unavailable target rig data by training the one or more layers of the 3D perception network as part of a training network using simulated source and target rig data. A consistency loss that compares (e.g., top-down) transformed feature maps extracted from simulated source and target rig data may be used to minimize differences across training channels. As such, one or more of the paths through the training network(s) may be designated as the 3D perception network, and target rig data may be applied to the 3D perception network to perform one or more perception tasks.