LLM Reasoning Challenges

Subbarao discusses the limitations of large language models in reasoning, emphasizing their strength in creative tasks but lack of guaranteed accuracy. He explores the recent developments in AI, including the implications of AGI and the potential for improved inference methods through candidate generation and self-consistency checks. The conversation also touches on the evolving relationship between Microsoft and OpenAI, raising questions about the future of AI funding and control.