Missing Component
David highlights the missing component in the AI alignment and super explosion issue. Unlike the continuation of values through generations in humanity, the creation of AI starts from scratch, lacking an evolutionary history to imbue it with values and judgment. This creates a challenge in understanding and aligning with AI as a completely new form of life.In this clip
From this podcast

Bankless
167 - Eliezer is Wrong. We’re NOT Going to Die with Robin Hanson
Related Questions
Can AI align with human values for a better future as discussed in the episode Max Tegmark: The Case for Halting AI Development | Lex Fridman Podcast #371 and the clip Social Media Redemption?
Can AI align with human values for a better future, as discussed in the episode Max Tegmark: Life 3.0 | Lex Fridman Podcast #1 and the clip Value Alignment Challenges?