Theory vs. Empirical Research
Greg Yang discusses the importance of picking battles between theory and empirical research in the field of deep learning. He highlights the leverage of theoretical insights in areas where experiments are not feasible and the economic advantages of theoretical insights over empirical ones.In this clip
From this podcast
The Gradient
Greg Yang on Communicating Research, Tensor Programs, and µTransfer
Related Questions