Data Wall Debate
John and Dwarkesh discuss the potential data wall in AI models, debating the impact of model size on transfer learning and the limitations of drawing conclusions from smaller models. They explore the nuances of pre-training data and its effects on model generalization.In this clip
From this podcast
Dwarkesh Podcast
John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI
Related Questions