专利检索 ap:("International Business Machines Corporation") AND inv:"Ariel Gera" 第 1 页

1.

发明授权
Inter-training of pre-trained transformer-based language models using partitioning and classification 有权

公开(公告)号：US12093645B2

公开(公告)日：2024-09-17

申请号：US17474364

申请日：2021-09-14

申请人： International Business Machines Corporation

发明人： Eyal Shnarch , Ariel Gera , Alon Halfon , Lena Dankin , Leshem Choshen , Ranit Aharonov , Noam Slonim

IPC分类号： G06F40/279 , G10L25/30

CPC分类号： G06F40/279 , G10L25/30

摘要： An example system includes a processor to pre-train a transformer-based language model on a general domain. The processor can inter-train the pre-trained transformer-based language model using partitioning and classification to generate an inter-trained transformer-based pre-trained language model. The processor can then fine-tune the inter-trained transformer-based pre-trained language model on a target task to generate a fine-tuned transformer-based language model.