发明申请
- 专利标题: UNIVERSAL TRANSFORMERS
-
申请号: US16417587申请日: 2019-05-20
-
公开(公告)号: US20190354567A1公开(公告)日: 2019-11-21
- 发明人: Mostafa Dehghani , Stephan Gouws , Oriol Vinyals , Jakob D. Uszkoreit , Lukasz Mieczyslaw Kaiser
- 申请人: Google LLC
- 主分类号: G06F17/14
- IPC分类号: G06F17/14 ; G06N3/04
摘要:
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing a sequence to sequence model that is recurrent in depth while employing self-attention to combine information from different parts of sequences.
公开/授权文献
- US10740433B2 Universal transformers 公开/授权日:2020-08-11
信息查询