公开(公告)号：US20220147713A1

公开(公告)日：2022-05-12

申请号：US17092230

申请日：2020-11-07

Applicant: Adobe Inc.

Inventor： Aparna Garimella ,  Kiran Kumar Rathlavath ,  Balaji Vasan Srinivasan ,  Anandhavelu Natarajan ,  Akhash Nakkonda Amarnath ,  Akash Pramod Yalla

IPC: G06F40/284 ,  G06F40/56 ,  G06K9/62

Abstract: A system for generating text using a trained language model comprises an encoder that includes a debiased language model that penalizes generated text based on an equalization loss that quantifies first and second probabilities of respective first and second tokens occurring at a first point in the generated text. The first and second tokens define respective first and second groups of people. The system further comprises a decoder configured to generate text using the debiased language model. The decoder is further configured to penalize the generated text based on a bias penalization loss that quantifies respective probabilities of the first and second tokens co-occurring with a generated word. The encoder and decoder are trained to produce the generated text using a task-specific training corpus.