Scaling AI Models
Matthew discusses the impact of scaling AI models like BERT and GPT-2, highlighting the need for substantial computing power and vast amounts of training data. He raises questions about data efficiency in AI systems compared to human language learning, sparking curiosity in the research community.In this clip
From this podcast
Data Skeptic
ELMo
Related Questions