Tim discusses revelations from conversations with Jan and Randall, highlighting a new perspective on neural networks as non-interpolators. Randall's spline theory shifts the view towards polyhedra and affirms the non-smooth nature of neural network behavior, demystifying the magic of deep learning.
