Published Sep 8, 2022

Christopher Manning: Linguistics and the Development of NLP

Explore the fascinating evolution of NLP with Christopher Manning, as he delves into the impact of multimodal models like DALL-E and Imagen, the challenges of semantics in current language models, and the transformative shift from traditional linguistics to neural networks in AI development.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

Christoffer Holmgård: AI for Video Games
Answers 383 questions
Tal Linzen: Psycholinguistics and Language Modeling
Answers 383 questions
Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science
Answers 383 questions
Linus Lee: At the Boundary of Machine and Mind
Answers 383 questions
Sasha Rush: Building Better NLP Systems
Answers 383 questions
Hugo Larochelle: Deep Learning as Science
Answers 383 questions
Luis Voloch: AI and Biology
Answers 383 questions
Stuart Russell: The Foundations of Artificial Intelligence
Answers 383 questions
Chip Huyen: Machine Learning Tools and Systems
Answers 383 questions
Percy Liang on Machine Learning Robustness, Foundation Models, and Reproducibility
Answers 383 questions
Greg Yang on Communicating Research, Tensor Programs, and µTransfer
Answers 383 questions
Cameron Jones & Sean Trott: Understanding, Grounding, and Reference in LLMs
Answers 383 questions
Yoshua Bengio: The Past, Present, and Future of Deep Learning
Answers 383 questions
Nicholas Thompson: AI and Journalism
Answers 383 questions
Eric Jang on Robots Learning at Google and Generalization via Language
Answers 383 questions

Dexa/Daniel Bashir

Christopher Manning: Linguistics and the Development of NLP

Topics covered

Popular Clips

Language Learning Complexity

Contrasting Linguistics and NLP

Language Models and Learning

The Shift in NLP

Courage and New Frontiers

Multimodal Models: Dolly Two vs. Imagen

Exploring Neural Architectures

Linguistics to NLP

Language and Meaning

Evolution of Neural Networks

Linguistics and Machine Learning

Language and Meaning

Embodiment and Learning

Statistical Power

Limitations and Ambiguities

Episode Highlights

Multimodal Models

Challenges in Language Models

History of NLP

Related Episodes

Christoffer Holmgård: AI for Video Games

Tal Linzen: Psycholinguistics and Language Modeling

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science

Linus Lee: At the Boundary of Machine and Mind

Sasha Rush: Building Better NLP Systems

Hugo Larochelle: Deep Learning as Science

Luis Voloch: AI and Biology

Stuart Russell: The Foundations of Artificial Intelligence

Chip Huyen: Machine Learning Tools and Systems

Percy Liang on Machine Learning Robustness, Foundation Models, and Reproducibility

Greg Yang on Communicating Research, Tensor Programs, and µTransfer

Cameron Jones & Sean Trott: Understanding, Grounding, and Reference in LLMs

Yoshua Bengio: The Past, Present, and Future of Deep Learning

Nicholas Thompson: AI and Journalism

Eric Jang on Robots Learning at Google and Generalization via Language

Christopher Manning: Linguistics and the Development of NLP

Topics covered

Popular Clips

Episode Highlights

Multimodal ModelsThe discussion contrasts DALL-E and Imagen, focusing on their approaches to multimodal models and the importance of physical grounding in learning. Christopher Manning explores how these elements impact language understanding and AI development.

Multimodal Models

Challenges in Language ModelsChristopher Manning discusses the limitations of current language models and their handling of semantics. He highlights the need for models with stronger inductive biases and argues for a nuanced understanding of meaning in language processing.

Challenges in Language Models

History of NLPChristopher Manning, Director of the Stanford AI Lab, discusses the intersection of linguistics and NLP, highlighting the evolution from traditional methods to neural networks. His insights reveal the transformative impact of statistical and neural approaches on language processing.

History of NLP

Related Episodes