公开(公告)号：US20240071105A1

公开(公告)日：2024-02-29

申请号：US18453439

申请日：2023-08-22

Applicant: NEC Laboratories America, Inc.

Inventor： Samuel Schulter ,  Bingbing Zhuang ,  Vijay Kumar Baikampady Gopalkrishna ,  Sparsh Garg ,  Zhixing Zhang

IPC: G06V20/56 ,  G06V10/774 ,  G06V10/80 ,  G06V10/82

CPC classification number: G06V20/588 ,  G06V10/7753 ,  G06V10/811 ,  G06V10/82 ,  G06V2201/07

Abstract: Methods and systems for training a model include pre-training a backbone model with a pre-training decoder, using an unlabeled dataset with multiple distinct sensor data modalities that derive from different sensor types. The backbone model is fine-tuned with an output decoder after pre-training, using a labeled dataset with the multiple modalities.