Open AccessRelative Positional Encoding for Transformers with Linear Complexity
Author(s) -
Antoine Liutkus,
Ondřej Cífka,
Shih-Lun Wu,
Umut Simsekli,
Yi-Hsuan Yang,
Gael Richard
Publication year - 2021
Publication title -
hal (le centre pour la communication scientifique directe)
Language(s) - English
Resource type - Conference proceedings
Subject(s) - computer science , encoding (memory) , transformer , algorithm , artificial intelligence , electrical engineering , engineering , voltage
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom