Liyuan discusses the challenges of competition math and the limitations of non-chain of thought models in reasoning. Emphasizing the importance of foundational knowledge, Liyuan explains how the Hermes model's performance was slightly improved through enhanced reasoning, yet still lagged behind more factually informed models like Sonnet 3.5. The conversation highlights the critical balance between reasoning capabilities and factual information in achieving better outcomes.
