Language Modeling Insights
Daniel and Cameron discuss the potential upper bounds of language model information extraction, suggesting a rudimentary form of theory of mind in text prediction. Sean adds skepticism on models' mentalizing abilities due to the lack of internal experiences as a reference point.In this clip
From this podcast
The Gradient
Cameron Jones & Sean Trott: Understanding, Grounding, and Reference in LLMs
Related Questions