公开(公告)号：US20240386202A1

公开(公告)日：2024-11-21

申请号：US18653146

申请日：2024-05-02

Applicant: Google LLC

Inventor： Matthew Douglas Hoffman ,  Charles Aloysius Sutton ,  David Martin Dohan ,  Sholto Francis Alexandre Douglas ,  Tuan Anh Le ,  Van Du Phan ,  Aaron Thomas Parisi ,  Ryan Michael Rifkin ,  Pavel Sountsov ,  Sharad Vikram

IPC: G06F40/284

Abstract: Systems and methods for generative language model tuning can include training the generative language model to generate sets of output text tokens with set of intermediary text tokens with training examples that include input and output pairs. The training can include processing the input with the language model to determine a predicted output and a predicted set of intermediary text tokens. The predicted set of intermediary text tokens can then be evaluated based at least in part on the output associated with the input and the predicted output.