Unraveling Training Noise
Hattie and Daniel discuss the complexities of the training process, highlighting the presence of noise and the challenge of understanding its impact. They also explore the possibility of identifying useful subnetworks before training begins, sharing insights from previous research on pruning methods.In this clip
From this podcast
The Gradient
Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs
Related Questions