Published Oct 13, 2022

Zachary Lipton: Where Machine Learning Falls Short

Zachary Lipton discusses his journey from music to academia while critiquing current approaches in machine learning, urging a rethink of pretraining models and emphasizing the limitations of algorithms in addressing social issues.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science
Answers 383 questions
Hugo Larochelle: Deep Learning as Science
Answers 383 questions
Ted Underwood: Machine Learning and the Literary Imagination
Answers 383 questions
Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs
Answers 383 questions
Been Kim: Interpretable Machine Learning
Answers 383 questions
Thomas Dietterich: From the Foundations
Answers 383 questions
Yann LeCun on his Start in Research and Self-Supervised Learning
Answers 383 questions
Eric Jang on Robots Learning at Google and Generalization via Language
Answers 383 questions
Melanie Mitchell: Abstraction and Analogy in AI
Answers 383 questions
Linus Lee: At the Boundary of Machine and Mind
Answers 383 questions
Scott Aaronson: Against AI Doomerism
Answers 383 questions
Nicholas Thompson: AI and Journalism
Answers 383 questions
Some Changes at The Gradient
Answers 383 questions
Luis Voloch: AI and Biology
Answers 383 questions
Joel Lehman: Open-Endedness and Evolution through Large Models
Answers 383 questions

Dexa/Daniel Bashir

Zachary Lipton: Where Machine Learning Falls Short

Topics covered

Popular Clips

Finding Inspiration

Finding Research Direction

Misconceptions in Distribution Shift

Uncovering Reading Comprehension

Uncovering Pretraining Benefits

Pretraining for Summarization

Algorithmic Fairness

Exploring Algorithmic Fairness

Teasing Out Causal Structure

Understanding Initialization

Formative Experiences

Revolutionizing Healthcare

Uncovering Question Answering Methods

Intuition and Precision

Episode Highlights

Navigating Academic Journeys

Pretraining in Machine Learning

Algorithmic Fairness

Related Episodes

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science

Hugo Larochelle: Deep Learning as Science

Ted Underwood: Machine Learning and the Literary Imagination

Hattie Zhou: Lottery Tickets and Algorithmic Reasoning in LLMs

Been Kim: Interpretable Machine Learning

Thomas Dietterich: From the Foundations

Yann LeCun on his Start in Research and Self-Supervised Learning

Eric Jang on Robots Learning at Google and Generalization via Language

Melanie Mitchell: Abstraction and Analogy in AI

Linus Lee: At the Boundary of Machine and Mind

Scott Aaronson: Against AI Doomerism

Nicholas Thompson: AI and Journalism

Some Changes at The Gradient

Luis Voloch: AI and Biology

Joel Lehman: Open-Endedness and Evolution through Large Models

Zachary Lipton: Where Machine Learning Falls Short

Topics covered

Popular Clips

Episode Highlights

Navigating Academic JourneysZachary Lipton shares his transformative journey from music to academia, highlighting the pivotal moments and influences that shaped his path. He discusses the challenges of balancing diverse academic interests and the importance of maintaining personal well-being.

Navigating Academic Journeys

Pretraining in Machine Learning

Algorithmic FairnessZachary Lipton critiques the over-optimistic belief that machine learning can solve complex social issues, known as ML solutionism. He emphasizes the importance of understanding the limitations of algorithms, especially in the context of fairness and legal standards.

Algorithmic Fairness

Related Episodes