The Kernel Limit
Greg explains the concept of kernel limits within the space of neural networks and highlights their significance. He discusses how these limits, while theoretically simple, have practical drawbacks such as the inability to learn features and rendering pretraining useless.In this clip
From this podcast
The Gradient
Greg Yang on Communicating Research, Tensor Programs, and µTransfer
Related Questions