Invention Grant
- Patent Title: Method and apparatus for decentralized supervised learning in NLP applications
-
Application No.: US17527167Application Date: 2021-11-16
-
Publication No.: US12112129B2Publication Date: 2024-10-08
- Inventor: Nuria Garcia Santa , Kendrick Cetina
- Applicant: Fujitsu Limited
- Applicant Address: JP Kawasaki
- Assignee: FUJITSU LIMITED
- Current Assignee: FUJITSU LIMITED
- Current Assignee Address: JP Kawasaki
- Agency: XSENSUS LLP
- Priority: EP 383052 2020.12.03
- Main IPC: G10L15/16
- IPC: G10L15/16 ; G06F18/214 ; G06F40/169 ; G06F40/226 ; G06N3/04 ; G10L15/06 ; G10L15/07 ; G10L15/18 ; G06F40/279 ; G06F40/295 ; G10L15/183

Abstract:
A method of training a neural network as a natural language processing, NLP, model, comprises: inputting annotated training data to first architecture portions of the neural network, the first architecture portions being executed respectively in a plurality of distributed client computing devices in communication with a server computing device, the training data being derived from text data private to the client computing device in which the first architecture portion is executed, the server computing device having no access to any of the private text data; deriving from the training data, using the first architecture portions, weight matrices of numeric weights which are decoupled from the private text data; concatenating the weight matrices, in a second architecture portion of the neural network executed in the server computing device, to obtain a single concatenated weight matrix; and training, on the second architecture portion, the NLP model using the concatenated weight matrix.
Public/Granted literature
- US20220180057A1 METHOD AND APPARATUS FOR DECENTRALIZED SUPERVISED LEARNING IN NLP APPLICATIONS Public/Granted day:2022-06-09
Information query