Predictive Processing and Language Models
Ryan discusses the similarities between predictive processing in human cognition and language models, highlighting the importance of predicting dynamics in the world for learning and understanding. He emphasizes the limitations of language models in terms of depth compared to human cognition.In this clip
From this podcast

Machine Learning Street Talk (MLST)
Ryan Greenblatt - Solving ARC with GPT4o
Related Questions
Is prediction and anticipation essentially the same in the context of the brain's predictive processes as discussed in the episode Ryan Greenblatt - Solving ARC with GPT4o and the clip Predictive Processing and Language Models?
Is prediction and anticipation essentially the same in the context of the brain's predictive processes, as discussed in the episode Ryan Greenblatt - Solving ARC with GPT4o and the clip Predictive Processing and Language Models?