Optimization algorithms for distributed machine learning
Auteur :
Joshi, Gauri
Éditeur :
Springer International Publishing AG
ISBN :
9783031190667
Date de publication :
26 nov. 2022
Dimensions :
24,0 x 16,8 cm
Langue :
Anglais
Pays d'origine :
Suisse
The author discusses several algorithms that improve the scalability and communication efficiency of synchronous SGD, such as asynchronous SGD, local-update SGD, quantized and sparsified SGD, and decentralized SGD.