Open AccessOn Scalar Embedding of Relative Positions in Attention Models
Author(s) -
Jitao Wu,
Richong Zhang,
Yongyi Mao,
Junfan Chen
Publication year - 2021
Publication title -
proceedings of the ... aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v35i16.17654
Subject(s) - embedding , computer science , probabilistic logic , encoding (memory) , scalar (mathematics) , artificial intelligence , transformer , heuristic , pattern recognition (psychology) , algorithm , mathematics , physics , geometry , quantum mechanics , voltage