-
公开(公告)号:US20250111210A1
公开(公告)日:2025-04-03
申请号:US18900531
申请日:2024-09-27
Applicant: Google LLC
Inventor: Chong You , Guru Guruganesh , Joshua Timothy Ainslie , Manzil Zaheer , Sanjiv Kumar , Santiago Ontañón , Shanda Li , Venkata Sesha Pavana Srinadh Bhojanapalli , Sumit Sanghai
IPC: G06N3/0475
Abstract: Systems and methods for processing inputs using attention neural networks. In particular, one or more of the attention layers within the attention neural network compute relative position biases using functional interpolation.