Transformer Data Analysis
Tim and Connor discuss the size of datasets and the implications for transformer models. Yannic raises concerns about the lack of grounding in large models and their reliance on training data for interpolation.In this clip
From this podcast
Machine Learning Street Talk (MLST)
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Related Questions