Open AccessALP-KD: Attention-Based Layer Projection for Knowledge Distillation
Author(s) -
Peyman Passban,
Yimeng Wu,
Mehdi Rezagholizadeh,
Qun Liu
Publication year - 2021
Publication title -
proceedings of the aaai conference on artificial intelligence
Language(s) - Uncategorized
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v35i15.17610
Subject(s) - distillation , computer science , layer (electronics) , rank (graph theory) , projection (relational algebra) , artificial neural network , quality (philosophy) , trustworthiness , artificial intelligence , machine learning , algorithm , chemistry , chromatography , mathematics , materials science , nanotechnology , philosophy , computer security , epistemology , combinatorics
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom