Invention Application
- Patent Title: Convolution-Augmented Transformer Models
-
Application No.: US17139525Application Date: 2020-12-31
-
Publication No.: US20220207321A1Publication Date: 2022-06-30
- Inventor: Anmol Gulati , Ruoming Pang , Niki Parmar , Jiahui Yu , Wei Han , Chung-Cheng Chiu , Yu Zhang , Yonghui Wu , Shibo Wang , Weikeng Qin , Zhengdong Zhang
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Main IPC: G06N3/04
- IPC: G06N3/04 ; G10L15/16 ; G06N20/00

Abstract:
Systems and methods can utilize a conformer model to process a data set for various data processing tasks, including, but not limited to, speech recognition, sound separation, protein synthesis determination, video or other image set analysis, and natural language processing. The conformer model can use feed-forward blocks, a self-attention block, and a convolution block to process data to learn global interactions and relative-offset-based local correlations of the input data.
Public/Granted literature
- US12079703B2 Convolution-augmented transformer models Public/Granted day:2024-09-03
Information query