Open AccessAutoBERT-Zero: Evolving BERT Backbone from Scratch
Author(s) -
Jing Gao,
Hang Xu,
Shi Han,
Xiaozhe Ren,
Philip L. H. Yu,
Xiaodan Liang,
Xin Jiang,
Zhenguo Li
Publication year - 2022
Publication title -
proceedings of the ... aaai conference on artificial intelligence
Language(s) - Uncategorized
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v36i10.21311
Subject(s) - computer science , language model , architecture , transformer , scratch , layer (electronics) , set (abstract data type) , artificial intelligence , scaling , dependency (uml) , convolution (computer science) , theoretical computer science , artificial neural network , programming language , art , chemistry , physics , geometry , mathematics , organic chemistry , quantum mechanics , voltage , visual arts