Subbarao discusses the concept of fractal intelligence in LLMs, highlighting the unpredictability of their performance and the limitations of current reasoning frameworks. Tim introduces the idea that these models might engage in various processes—sometimes retrieving facts, other times generating procedural information—suggesting a more nuanced understanding of their capabilities. The conversation emphasizes the ongoing challenge of characterizing what LLMs are truly doing.
