Published Apr 28, 2022
Greg Yang on Communicating Research, Tensor Programs, and µTransfer
Greg Yang delves into the transformative landscape of AI research, highlighting his pioneering work on hyperparameter transfer, the Tensor Programs framework, and the delicate balance between theoretical insights and empirical practice. From his unconventional path to becoming a senior researcher at Microsoft to his ambitious pursuit of Artificial General Intelligence, Yang offers a compelling narrative on innovation and the mathematics driving AI forward.

Topics covered
Popular Clips
Episode Highlights
Related Episodes


Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science
Answers 383 questions

Eric Jang on Robots Learning at Google and Generalization via Language
Answers 383 questions

Been Kim: Interpretable Machine Learning
Answers 383 questions

Hugo Larochelle: Deep Learning as Science
Answers 383 questions

Yoshua Bengio: The Past, Present, and Future of Deep Learning
Answers 383 questions

Ed Grefenstette: Language, Semantics, Cohere
Answers 383 questions

Percy Liang on Machine Learning Robustness, Foundation Models, and Reproducibility
Answers 383 questions

Yannic Kilcher on Being an AI Researcher and Educator
Answers 383 questions

Yann LeCun on his Start in Research and Self-Supervised Learning
Answers 383 questions

Some Changes at The Gradient
Answers 383 questions

Christopher Manning: Linguistics and the Development of NLP
Answers 383 questions

Peter Lee: Computing Theory and Practice, and GPT-4's Impact
Answers 383 questions

Chip Huyen: Machine Learning Tools and Systems
Answers 383 questions

Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs
Answers 383 questions
