Invention Grant
- Patent Title: Self-learning framework of zero-shot cross-lingual transfer with uncertainty estimation
-
Application No.: US17723942Application Date: 2022-04-19
-
Publication No.: US12073183B2Publication Date: 2024-08-27
- Inventor: Xuchao Zhang , Haifeng Chen
- Applicant: NEC Laboratories America, Inc.
- Applicant Address: US NJ Princeton
- Assignee: NEC Corporation
- Current Assignee: NEC Corporation
- Current Assignee Address: JP Tokyo
- Agent Joseph Kolodka
- Main IPC: G06F40/295
- IPC: G06F40/295 ; G06N5/046 ; G06N20/00

Abstract:
A method provided for cross-lingual transfer trains a pre-trained multi-lingual language model based on a gold labeled training set in a source language to obtain a trained model. The method assigns each sample in an unlabeled target language set to a silver label according to a model prediction by the trained model to obtain set of silver labels, and performs uncertainty-aware label selection based on the silver label assigned to each sample according to the model prediction and the trained model to obtain selected silver labels. The method performs iterative training on the selected labels by applying the selected silver labels in the target language set as training labels and re-training the trained model with the gold labels and the selected silver labels to obtain an iterative model, and performs task-specific result prediction in target languages based on the iterative model to generate a final predicted result in target languages.
Public/Granted literature
- US20220366143A1 SELF-LEARNING FRAMEWORK OF ZERO-SHOT CROSS-LINGUAL TRANSFER WITH UNCERTAINTY ESTIMATION Public/Granted day:2022-11-17
Information query