Open AccessFrom Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression
Author(s) -
Runxin Xu,
Fuli Luo,
Chengyu Wang,
Baobao Chang,
Jun Huang,
Songfang Huang,
Fei Huang
Publication year - 2022
Publication title -
proceedings of the aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v36i10.21408
Subject(s) - pruning , computer science , language model , generalization , task (project management) , artificial intelligence , machine learning , forgetting , natural language processing , mathematics , mathematical analysis , linguistics , philosophy , management , agronomy , economics , biology
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom