公开(公告)号：US20220147761A1

公开(公告)日：2022-05-12

申请号：US17521057

申请日：2021-11-08

Applicant: NEC Laboratories America, Inc.

Inventor： Yi-Hsuan Tsai ,  Xiang Yu ,  Bingbing Zhuang ,  Manmohan Chandraker ,  Donghyun Kim

IPC: G06K9/62 ,  G06N3/08

Abstract: Video methods and systems include extracting features of a first modality and a second modality from a labeled first training dataset in a first domain and an unlabeled second training dataset in a second domain. A video analysis model is trained using contrastive learning on the extracted features, including optimization of a loss function that includes a cross-domain regularization part and a cross-modality regularization part.

公开(公告)号：US20240037187A1

公开(公告)日：2024-02-01

申请号：US18484832

申请日：2023-10-11

Applicant: NEC Laboratories America, Inc.

Inventor： Yi-Hsuan Tsai ,  Xiang Yu ,  Bingbing Zhuang ,  Manmohan Chandraker ,  Donghyun Kim

IPC: G06F18/213 ,  G06N3/08 ,  G06V10/75 ,  G06F18/22 ,  G06F18/214

CPC classification number: G06F18/213 ,  G06N3/08 ,  G06V10/751 ,  G06F18/22 ,  G06F18/2155

Abstract: Video methods and systems include extracting features of a first modality and a second modality from a labeled first training dataset in a first domain and an unlabeled second training dataset in a second domain. A video analysis model is trained using contrastive learning on the extracted features, including optimization of a loss function that includes a cross-domain regularization part and a cross-modality regularization part.

公开(公告)号：US20240037186A1

公开(公告)日：2024-02-01

申请号：US18484826

申请日：2023-10-11

Applicant: NEC Laboratories America, Inc.

Inventor： Yi-Hsuan Tsai ,  Xiang Yu ,  Bingbing Zhuang ,  Manmohan Chandraker ,  Donghyun Kim

IPC: G06F18/213 ,  G06N3/08 ,  G06V10/75 ,  G06F18/22 ,  G06F18/214

CPC classification number: G06F18/213 ,  G06N3/08 ,  G06V10/751 ,  G06F18/22 ,  G06F18/2155

Abstract: Video methods and systems include extracting features of a first modality and a second modality from a labeled first training dataset in a first domain and an unlabeled second training dataset in a second domain. A video analysis model is trained using contrastive learning on the extracted features, including optimization of a loss function that includes a cross-domain regularization part and a cross-modality regularization part.

公开(公告)号：US20240037188A1

公开(公告)日：2024-02-01

申请号：US18484839

申请日：2023-10-11

Applicant: NEC Laboratories America, Inc.

Inventor： Yi-Hsuan Tsai ,  Xiang Yu ,  Bingbing Zhuang ,  Manmohan Chandraker ,  Donghyun Kim

IPC: G06F18/213 ,  G06N3/08 ,  G06V10/75 ,  G06F18/22 ,  G06F18/214

CPC classification number: G06F18/213 ,  G06N3/08 ,  G06V10/751 ,  G06F18/22 ,  G06F18/2155

Abstract: Video methods and systems include extracting features of a first modality and a second modality from a labeled first training dataset in a first domain and an unlabeled second training dataset in a second domain. A video analysis model is trained using contrastive learning on the extracted features, including optimization of a loss function that includes a cross-domain regularization part and a cross-modality regularization part.