
When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism
Author(s) -
Guangting Wang,
Yucheng Zhao,
Chengxiang Tang,
Chong Luo,
Wenjun Zeng
Publication year - 2022
Publication title -
proceedings of the ... aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v36i2.20142
Subject(s) - computer science , transformer , simple (philosophy) , mechanism (biology) , construct (python library) , artificial intelligence , algorithm , electrical engineering , programming language , engineering , philosophy , epistemology , voltage