Open AccessLarge Batch Optimization for Deep Learning Using New Complete Layer-Wise Adaptive Rate Scaling
Author(s) -
Zhouyuan Huo,
Bin Gu,
Heng Huang
Publication year - 2021
Publication title -
proceedings of the ... aaai conference on artificial intelligence
Language(s) - English
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v35i9.16962
Subject(s) - computer science , convergence (economics) , scaling , margin (machine learning) , deep neural networks , deep learning , artificial neural network , rate of convergence , artificial intelligence , layer (electronics) , algorithm , linear scale , machine learning , mathematics , key (lock) , chemistry , geometry , computer security , organic chemistry , economics , economic growth , geodesy , geography