Open AccessOn Scalar Embedding of Relative Positions in Attention Models
Author(s) -
Junshuang Wu,
Richong Zhang,
Yongyi Mao,
Junfan Chen
Publication year - 2021
Publication title -
proceedings of the aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v35i16.17654
Subject(s) - embedding , computer science , probabilistic logic , encoding (memory) , scalar (mathematics) , artificial intelligence , transformer , heuristic , pattern recognition (psychology) , algorithm , mathematics , physics , geometry , quantum mechanics , voltage
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom