Less Is More: Pay Less Attention in Vision Transformers
Author(s) -
Zizheng Pan,
Bohan Zhuang,
Haoyu He,
Jing Liu,
Jianfei Cai
Publication year - 2022
Publication title -
proceedings of the aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v36i2.20099
Subject(s) - computer science , transformer , artificial intelligence , inference , segmentation , convolutional neural network , perceptron , pattern recognition (psychology) , machine learning , computer vision , artificial neural network , engineering , voltage , electrical engineering
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom