Distributional Generalization
Preetum discusses the concept of distributional generalization and emphasizes the importance of studying the joint distribution of inputs and outputs. By understanding the structure of this joint distribution, we can gain insights into the model's performance and error patterns on both the train and test sets.In this clip
From this podcast

The Gradient
Preetum Nakkiran: An Empirical Theory of Deep Learning
Related Questions