Language Model Limitations
Tim discusses the challenges of relying on language models, highlighting the risk of models overfitting to irrelevant data artifacts rather than genuinely understanding tasks. He expresses skepticism about the current architecture's potential for significant breakthroughs, suggesting that insights from cognitive science and childhood language acquisition could inspire more effective approaches to grounded language learning.In this clip
From this podcast
Data Skeptic
BERT is Shallow
Related Questions