Preetum Nakkiran discusses the role of inductive biases in the process of double descent and how they contribute to the performance gains beyond the interpolation threshold. He emphasizes the importance of good inductive biases and explores ways to characterize and evaluate them.
