Fortuitous Forgetting
Hattie explains the concept of fortuitous forgetting, which explores the symbiotic relationship between forgetting and learning in both human brains and artificial neural networks. By using a forget and relearn paradigm, Hattie suggests that iterative training processes can amplify desirable information within the model, leading to better performance and generalization.In this clip
From this podcast

The Gradient
Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs
Related Questions