公开(公告)号：US20250095637A1

公开(公告)日：2025-03-20

申请号：US18886581

申请日：2024-09-16

Applicant: Google LLC

Inventor： Ke Hu ,  Tara N. Sainath ,  Bo Li ,  Yu Zhang ,  Yong Cheng ,  Tao Wang ,  Yujing Zhang ,  Frederick Liu

IPC: G10L15/06 ,  G10L15/00

Abstract: A method includes receiving a textual prompt in a first language and obtaining a fine-tuned prompt embedding configured to guide a large language model (LLM) to generate text in a target language from textual prompts in the first language. The method also includes processing, using the LLM, the textual prompt conditioned on the fine-tuned prompt embedding to generate output text in the target language and concatenating the textual prompt and the generated output text to provide an unspoken textual utterance. The method also includes training a multilingual automatic speech recognition (ASR) model to learn how to recognize speech in the target language by injecting the unspoken textual utterance into a text encoder associated with the multilingual ASR model.

公开(公告)号：US20240378427A1

公开(公告)日：2024-11-14

申请号：US18661499

申请日：2024-05-10

Applicant: Google LLC

Inventor： Slav Petrov ,  Yonghui Wu ,  Andrew M. Dai ,  David Richard So ,  Dmitry Lepikhin ,  Erica Ann Moreira ,  Gaurav Mishra ,  Jonathan Hudson Clark ,  Maxim Krikun ,  Melvin Jose Johnson Premkumar ,  Nan Du ,  Orhan Firat ,  Rohan Anil ,  Siamak Shakeri ,  Xavier Garcia ,  Yanping Huang ,  Yong Cheng ,  Yuanzhong Xu ,  Yujing Zhang ,  Zachary Alexander Nado ,  Eric Jun Jie Ni ,  Kefan Xiao ,  Vladimir Feinberg ,  Jin Young Sohn ,  Aurko Roy

IPC: G06N3/0475 ,  G06F40/284

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to perform any one or more of a variety of machine learning tasks. For example, the neural network can be configured as a generative neural network, e.g., an autoregressive generative neural network.

公开(公告)号：US20240378441A1

公开(公告)日：2024-11-14

申请号：US18661447

申请日：2024-05-10

Applicant: Google LLC

Inventor： Slav Petrov ,  Yonghui Wu ,  Andrew M. Dai ,  David Richard So ,  Dmitry Lepikhin ,  Erica Ann Moreira ,  Gaurav Mishra ,  Jonathan Hudson Clark ,  Maxim Krikun ,  Melvin Jose Johnson Premkumar ,  Nan Du ,  Orhan Firat ,  Rohan Anil ,  Siamak Shakeri ,  Xavier Garcia ,  Yanping Huang ,  Yong Cheng ,  Yuanzhong Xu ,  Yujing Zhang ,  Zachary Alexander Nado ,  Eric Jun Jie Ni ,  Kefan Xiao ,  Vladimir Feinberg ,  Jin Young Sohn ,  Aurko Roy

IPC: G06N3/08

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to perform any one or more of a variety of machine learning tasks. For example, the neural network can be configured as a generative neural network, e.g., an autoregressive generative neural network.