Loss Change Allocation
Rosanne discusses the surprising findings of the Loss Change Allocation study, revealing how parameters in neural networks can hurt training processes. The research suggests using a different momentum term for the last layer to improve results.In this clip
From this podcast
Gradient Dissent - A Machine Learning Podcast
Rosanne Liu — Conducting Fundamental ML Research as a Nonprofit
Related Questions