Open AccessAdaComp : Adaptive Residual Gradient Compression for Data-Parallel Distributed Training
Author(s) -
ChiaYu Chen,
Jungwook Choi,
Daniël Brand,
Ankur Agrawal,
Wei Zhang,
Kailash Gopalakrishnan
Publication year - 2018
Publication title -
proceedings of the ... aaai conference on artificial intelligence
Language(s) - Uncategorized
Resource type - Journals
eISSN - 2374-3468
pISSN - 2159-5399
DOI - 10.1609/aaai.v32i1.11728
Subject(s) - mnist database , computer science , residual , convolutional neural network , artificial intelligence , stochastic gradient descent , artificial neural network , quantization (signal processing) , deep learning , compression (physics) , deep neural networks , pattern recognition (psychology) , computer engineering , machine learning , algorithm , materials science , composite material