Published Jan 23, 2025

Subbarao Kambhampati - Do o1 models search?

Subbarao Kambhampati delves into the complexities of fractal intelligence in AI, discussing the limitations of mechanistic interpretability and the challenges of sound reasoning in reasoning versus retrieval models. The episode also addresses the cost-efficiency debates of hybrid versus single-model architectures in AI system design.

Episode Highlights

Topics covered

Questions from this episode

- Tell me something about artificial intelligence
  Asked by 131 people
- What are some hot takes on web-based AI agents?
  Asked by 83 people
- What's next in large language models (LLMs)?
  Asked by 34 people
- What are some applications of language models?
  Asked by 30 people
- Is reinforcement learning a turning point for large language models (LLMs) and artificial intelligence (AI)?
  Asked by 29 people
- Tell me something unique about large language models in the context of the episode Stephen Wolfram: ChatGPT and the Nature of Truth, Reality & Computation | Lex Fridman Podcast #376 and the clip Language Model Limitations
  Asked by 26 people
- What techniques are used with large language models (LLMs)?
  Asked by 24 people
- Tell me something unique about large language models
  Asked by 23 people
- What are the next advancements in large language models (LLMs)?
  Asked by 22 people
- What is the best insight on prompt engineering and engaging large language models (LLMs)?
  Asked by 15 people
- What technologies contribute to AI reasoning breakthroughs?
  Asked by 15 people
- Tell me something unique about large language models in the context of the episode 972: Mustafa Suleyman | Navigating The 21st Century's Greatest Dilemma and the clip Language Models' Predictive Power
  Asked by 15 people
- What kind of products or apps will you see that combine large language models (LLMs) for software engineering?
  Asked by 14 people
- How will large language models (LLMs) and AI change software engineering and the software development lifecycle (SDLC) as discussed in the episode Meta’s Joe Spisak on Llama 3.1 405B and the Democratization of Frontier Models | Training Data and the clip Scaling Innovations?
  Asked by 10 people
- What do you think about the potential for Large Language Models (LLMs) to scale to Artificial General Intelligence (AGI) as discussed in the episode Andrej Karpathy: Tesla AI, Self-Driving, Optimus, Aliens, and AGI | Lex Fridman Podcast #333 and the clip Path to AGI?
  Asked by 8 people

Episode Highlights

Related Episodes

Prof. Subbarao Kambhampati - LLMs don't reason, they memorize (ICML2024 2/13)
Answers 383 questions
Sepp Hochreiter - LSTM: The Comeback Story?
Answers 383 questions
How Do AI Models Actually Think? - Laura Ruis
Answers 383 questions
Daniel Franzen & Jan Disselhoff - ARC Prize 2024 winners
Answers 383 questions
Pattern Recognition vs True Intelligence - Francois Chollet
Answers 383 questions
OpenAI GPT-3: Language Models are Few-Shot Learners
Answers 383 questions
Jürgen Schmidhuber - Neural and Non-Neural AI, Reasoning, Transformers, and LSTMs
Answers 383 questions
MLST #78 - Prof. NOAM CHOMSKY (Special Edition)
Answers 383 questions
It's Not About Scale, It's About Abstraction - Francois Chollet
Answers 383 questions
#73 - YASAMAN RAZEGHI & Prof. SAMEER SINGH - NLP benchmarks
Answers 383 questions
Jay Alammar on LLMs, RAG, and AI Engineering
Answers 383 questions
#90 - Prof. DAVID CHALMERS - Consciousness in LLMs [Special Edition]
Answers 383 questions
Mahault Albarracin - Cognitive Science
Answers 383 questions
ICLR 2020: Yoshua Bengio and the Nature of Consciousness
Answers 383 questions
Open-Ended AI: The Key to Superhuman Intelligence? - Prof. Tim Rocktäschel
Answers 383 questions

Subbarao Kambhampati - Do o1 models search?

Topics covered

Popular Clips

Questions from this episode

Episode Highlights

Fractal Intelligence

Reasoning Models

AI System Design

Related Episodes