公开(公告)号：US20240104353A1

公开(公告)日：2024-03-28

申请号：US18274748

申请日：2022-02-08

Applicant: DeepMind Technologies Limited

Inventor： Rémi Bertrand Francis Leblond ,  Jean-Baptiste Alayrac ,  Laurent Sifre ,  Miruna Pîslar ,  Jean-Baptiste Lespiau ,  Ioannis Antonoglou ,  Karen Simonyan ,  David Silver ,  Oriol Vinyals

IPC: G06N3/0455

CPC classification number: G06N3/0455

Abstract: A computer-implemented method for generating an output token sequence from an input token sequence. The method combines a look ahead tree search, such as a Monte Carlo tree search, with a sequence-to-sequence neural network system. The sequence-to-sequence neural network system has a policy output defining a next token probability distribution, and may include a value neural network providing a value output to evaluate a sequence. An initial partial output sequence is extended using the look ahead tree search guided by the policy output and, in implementations, the value output, of the sequence-to-sequence neural network system until a complete output sequence is obtained.