Published May 19, 2020
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Dive into the groundbreaking T5 model from Google AI as Tim Scarfe, Yannic Kilcher, and Connor Shorten unravel its text-to-text framework, explore crucial architectural elements, and address key challenges in neural network generalization, offering a transformative perspective on transfer learning in NLP.

Topics covered
Popular Clips
Episode Highlights
Related Episodes


#039 - Lena Voita - NLP
Answers 383 questions

Facebook Research - Unsupervised Translation of Programming Languages
Answers 383 questions

OpenAI GPT-3: Language Models are Few-Shot Learners
Answers 383 questions

Explainability, Reasoning, Priors and GPT-3
Answers 383 questions

NLP is not NLU and GPT-3 - Walid Saba
Answers 383 questions

Is ChatGPT an N-gram model on steroids?
Answers 383 questions

#044 - Data-efficient Image Transformers (Hugo Touvron)
Answers 383 questions

Jordan Edwards: ML Engineering and DevOps on AzureML
Answers 383 questions

Jürgen Schmidhuber - Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs
Answers 383 questions

#53 Quantum Natural Language Processing - Prof. Bob Coecke (Oxford)
Answers 383 questions

ICLR 2020: Yoshua Bengio and the Nature of Consciousness
Answers 383 questions

Jurgen Schmidhuber on Humans co-existing with AIs
Answers 383 questions

MLST #78 - Prof. NOAM CHOMSKY (Special Edition)
Answers 383 questions

#114 - Secrets of Deep Reinforcement Learning (Minqi Jiang)
Answers 383 questions

#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!
Answers 383 questions
