公开(公告)号：US20240428056A1

公开(公告)日：2024-12-26

申请号：US18750973

申请日：2024-06-21

Applicant: Google LLC

Inventor： Paul Kishan Rubenstein ,  Matthew Sharifi ,  Alexandru Tudor ,  Chulayuth Asawaroengchai ,  Duc Dung Nguyen ,  Marco Tagliasacchi ,  Neil Zeghidour ,  Zalán Borsos ,  Christian Frank ,  Dalia Salem Hassan Fahmy Elbadawy ,  Hannah Raphaelle Muckenhirn ,  Dirk Ryan Padfield ,  Damien Vincent ,  Evgeny Kharitonov ,  Michelle Dana Tadmor ,  Mihajlo Velimirovic ,  Feifan Chen ,  Victoria Zayats

IPC: G06N3/0475 ,  G10L25/30

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing tasks. One of the methods includes obtaining a sequence of input tokens, where each token is selected from a vocabulary of tokens that includes text tokens and audio tokens, and wherein the sequence of input tokens includes tokens that describe a task to be performed and data for performing the task; generating a sequence of embeddings by embedding each token in the sequence of input tokens in an embedding space; and processing the sequence of embeddings using a language model neural network to generate a sequence of output tokens for the task, where each token is selected from the vocabulary.