- Patent Title: Efficient decoding of output sequences using adaptive early exiting
-
Application No.: US18222395Application Date: 2023-07-14
-
Publication No.: US11886976B1Publication Date: 2024-01-30
- Inventor: Tal Schuster , Adam Joshua Fisch , Jai Prakash Gupta , Mostafa Dehghani , Dara Bahri , Vinh Quoc Tran , Yi Tay , Donald Arthur Metzler, Jr.
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Fish & Richardson P.C.
- Main IPC: G06N3/0455
- IPC: G06N3/0455
Abstract:
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating output sequences using auto-regressive decoder neural networks. In particular, during generation, adaptive early exiting is used to reduce the time required to generate the output sequence.
Public/Granted literature
- US20240020516A1 EFFICIENT DECODING OF OUTPUT SEQUENCES USING ADAPTIVE EARLY EXITING Public/Granted day:2024-01-18
Information query
