Powerful Insights
Greg shares powerful insights on the potential of tensor programs, highlighting their ability to encompass the entire training and inference process. He also discusses the different limits of large neural networks and their corresponding effects, providing a definitive answer to the question of which parameterization to use when training larger networks.In this clip
From this podcast

The Gradient
Greg Yang on Communicating Research, Tensor Programs, and µTransfer
Related Questions
What is the main topic of the clip Tensor Programs: Unlocking Deep Learning Potential from the episode Greg Yang on Communicating Research, Tensor Programs, and µTransfer?
What is the clip Tensor Programs: Unlocking Deep Learning Potential about from the episode Greg Yang on Communicating Research, Tensor Programs, and µTransfer?