Kevin Dorst: Against Irrationalist Narratives

Topics covered
Popular Clips
Episode Highlights
Confidence Levels
In the realm of rational confidence, explores the nuances of how individuals perceive their own rationality. He distinguishes between being rational enough and ideally rational, acknowledging that most people fall short of the ideal due to limited computational power and occasional mistakes 1. Dorst illustrates this with the example of someone who is 90% confident in a belief but recognizes that an ideally rational version of themselves would either be 100% or 0% confident. This highlights the complexity of maintaining rational confidence levels when faced with uncertainty about one's own rationality.
It's when I don't know which way an ideal version would go that I can sort of stably have this belief or credence and not move in that direction.
---
He further discusses how people can be miscalibrated in their beliefs due to outdated information, emphasizing that rationality does not always equate to having accurate evidence 2.
  Â
Ambiguity
Ambiguity in evidence plays a crucial role in shaping rational beliefs and polarization. explains that ambiguity is relative to notions of rational belief, distinguishing between ideally rational and human-level rationality 3. This distinction allows for different interpretations of evidence, leading to varied belief formations. Dorst uses the example of a red wall that appears red due to a red light, illustrating how evidence can be misleading without additional context 4.
It's no surprise that we have rationality debates going on all the time about rational.
---
Such ambiguity can lead to rational polarization, where individuals form beliefs based on their interpretations of ambiguous evidence.
  Â
Rationality's Impact
The impact of rationality judgments extends beyond individual beliefs, influencing societal polarization. highlights how judgments about rationality affect our perceptions of others, often leading to polarization based on perceived rational or irrational behavior 5. He notes that these judgments are intertwined with normative notions that guide our reactions to differing opinions.
Insofar as rationality judgments and normative judgments more generally are driving how we feel about other people, then there's a rich space for both psychology, which has sort of run the show for much of the last 40 years in public discourse about rationality.
---
Dorst also reflects on how personal experiences and social contexts shape beliefs, acknowledging that while some influences may seem arbitrary, they often stem from reasonable processes 6.
Related Episodes


David Thorstad: Bounded Rationality and the Case Against Longtermism
Answers 383 questions

Pete Wolfendale: The Revenge of Reason
Answers 383 questions

Scott Aaronson: Against AI Doomerism
Answers 383 questions

Seth Lazar: Normative Philosophy of Computing
Answers 383 questions

Stuart Russell: The Foundations of Artificial Intelligence
Answers 383 questions

Melanie Mitchell: Abstraction and Analogy in AI
Answers 383 questions

Stevan Harnad: AI's Symbol Grounding Problem
Answers 383 questions

Harvey Lederman: Propositional Attitudes and Reference in Language Models
Answers 383 questions

François Chollet: Keras and Measures of Intelligence
Answers 383 questions

Michael Levin & Adam Goldstein: Intelligence and its Many Scales
Answers 383 questions

Catherine Olsson and Nelson Elhage: Anthropic, Understanding Transformers
Answers 383 questions

Subbarao Kambhampati: Planning, Reasoning, and Interpretability in the Age of LLMs
Answers 383 questions

David Chalmers on AI and Consciousness
Answers 383 questions

Terry Winograd: AI, HCI, Language, and Cognition
Answers 383 questions

Kathleen Fisher: DARPA and AI for National Security
Answers 383 questions
