Learning Limitations
Subbarao discusses the challenges LLMs face in understanding complex tasks, using the analogy of stacking blocks. He highlights that while LLMs can handle simple problems, they struggle as complexity increases, requiring explicit guidance for each step. This illustrates a fundamental limitation in their learning process, akin to needing constant instruction rather than developing a deeper understanding.In this clip
From this podcast
Machine Learning Street Talk (MLST)
Prof. Subbarao Kambhampati - LLMs don't reason, they memorize (ICML2024 2/13)
Related Questions