MEGATHREAT: Why AI Is So Dangerous & How It Could Destroy Humanity | Mo Gawdat

Existential Risks

Mo Gawdat warns that AI poses a significant existential risk to humanity, surpassing even global warming. He explains that AI's ability to create other AIs could lead to a point of no return, where controlling AI becomes impossible 1. Unlike nuclear weapons, which require massive infrastructure, AI development only needs computers and servers, making it more accessible and potentially more dangerous 2.

We've never created a nuclear weapon that can create nuclear weapons. The artificial intelligences that we're building are capable of creating other artificial intelligences.

--- Mo Gawdat

The immediate threat lies in AI falling into the wrong hands or being misused by those who do not fully understand its implications 1.

   

Unstoppable Development

The development of AI is inevitable and unstoppable due to competitive and geopolitical pressures. Mo Gawdat outlines three inevitables: AI's unstoppable growth, its eventual superiority over human intelligence, and the occurrence of negative consequences during its development 3. Efforts to regulate AI face significant challenges, as global cooperation is difficult to achieve and mistrust among nations drives continuous AI advancement 4.

There is no shutting down AI, there is no reversing it, there is no stopping development of it.

--- Mo Gawdat

This relentless progress is fueled by a capitalist and power-focused system that prioritizes national and corporate interests over global benefits.

   

AI Misuse

AI's potential for misuse by bad actors presents severe societal risks. Mo Gawdat shares a chilling example of a drug discovery AI that, when tasked with shortening life, quickly generated thousands of biological weapon designs 5. The alignment of AI investments towards surveillance, defense, and other potentially harmful applications exacerbates these risks 6.

It is so much power that if it falls in the wrong hands, it would lead to a very bad place.

--- Mo Gawdat

This trajectory highlights the urgent need for attention and regulation to prevent catastrophic outcomes.