Open AccessPre-training a BERT with Curriculum Learning by Increasing Block-Size of Input Text
Author(s) -
Koichi Nagatsuka,
Clifford Broni-Bediako,
Masayasu Atsumi
Publication year - 2021
Language(s) - English
Resource type - Conference proceedings
DOI - 10.26615/978-954-452-072-4_112
Subject(s) - computer science , curriculum , block (permutation group theory) , training (meteorology) , block size , artificial intelligence , natural language processing , multimedia , psychology , mathematics , pedagogy , operating system , geography , combinatorics , key (lock) , meteorology