The Alignment Problem

Vahid discusses the challenges of defining objective functions for AI agents, using examples of robotic vacuum cleaners and self-driving cars. He highlights the difficulty of aligning objectives with desired outcomes and the need for verifiable alignment.