Machine Learning Street Talk (MLST) avatar

Dexa/Machine Learning Street Talk (MLST)

Learn more
Published Feb 5, 2023

#99 - CARLA CREMER & IGOR KRAWCZUK - X-Risk, Governance, Effective Altruism

Dive into existential risk management and governance with Tim Scarfe, Carla Cremer, and Igor Krawczuk as they dissect effective altruism's philosophical roots, the intricate dynamics of AI risk, and the imperative of collective rationality in navigating today's politically charged landscape.
Episode Highlights
Machine Learning Street Talk (MLST) logo

Topics covered

Popular Clips

Episode Highlights

  • Diverse Views

    Diverse perspectives are crucial for effective risk management. argues that incorporating a variety of viewpoints helps identify and mitigate risks that might be overlooked by a homogenous group 1. He emphasizes the importance of collective rationality, where the focus is on finding procedures that aggregate diverse opinions to achieve useful outcomes 1. This approach ensures that decisions are not dominated by a single perspective but are the result of a well-rounded deliberation process 2.

    If you want to protect people from risk, you need to listen to them about what they consider to be a risk that is a bad outcome that they don't want to live under.

    ---

    By engaging diverse groups in decision-making, we can create more resilient and inclusive policies.

       

    Epistemic Risks

    Epistemic risks, such as ignorance and misinformation, pose significant challenges to effective risk management. highlights the industrialization of misinformation as a major concern, particularly with the rise of large language models 3. He stresses the need for empowering people to critically engage with media to combat these risks 3. adds that epistemic risks are pervasive and can lead to catastrophic outcomes if not addressed properly 4.

    Epistemic risks contribute ubiquitously to our lives. We risk missing the bus if we don't know the time. We risk infecting granny if we don't know we're carrying a virus.

    ---

    Addressing these risks requires a concerted effort to improve education and media literacy.

       

    Risk Mitigation

    Effective risk mitigation strategies are essential for managing the complexities of AI and global technologies. argues that those who aim to manage risks for humanity must demonstrate superior epistemic procedures 5. He calls for an institutional turn to incorporate diverse perspectives in risk assessment 5. Additionally, Carla Cremer6.

    The ambition here is nothing less but to protect or do risk management for the whole of humanity and the future of all of our children and children's children.

    ---

    By focusing on practical and inclusive approaches, we can better navigate the risks associated with advanced technologies.

Related Episodes