Published May 31, 2018
Deep Gradient Compression for Distributed Training with Song Han - #146
Explore deep gradient compression with MIT's Song Han as he delves into momentum techniques and warm-up training to optimize distributed neural network training, enhancing accuracy and efficiency even on commodity hardware.
Topics covered
Popular Clips
Episode Highlights
Related Episodes
Accelerating Deep Learning with Mixed Precision Arithmetic, w/ Greg Diamos - #97
Answers 383 questions
Deep Learning for Warehouse Operations with Calvin Seward - #38
Answers 383 questions
Scaleable Distributed Deep Learning with Hillery Hunter - #77
Answers 383 questions
Advances in Neural Compression with Auke Wiggers - #570
Answers 383 questions
Trends in Machine Learning & Deep Learning with Zack Lipton - #334
Answers 383 questions
Systems and Software for Machine Learning at Scale with Jeff Dean - #124
Answers 383 questions
Scaling TensorFlow at LinkedIn with Jonathan Hung - #314
Answers 383 questions
Vector Quantization for NN Compression with Julieta Martinez - #498
Answers 383 questions
Embedded Deep Learning at Deep Vision with Siddha Ganju - #95
Answers 383 questions
Deep Learning is Eating 5G. Here’s How, w/ Joseph Soriaga - #525
Answers 383 questions
Stable Diffusion and LLMs at the Edge with Jilei Hou - 633
Answers 383 questions
