Optimization Pressure and Goodheart's Curse
Eliezer discusses how optimization pressure can lead to unintended consequences and the phenomenon known as Goodheart's Curse. He uses the example of test scores and carpentry to illustrate how optimizing for a specific metric can result in a loss of overall proficiency.In this clip
From this podcast
Dwarkesh Podcast
Eliezer Yudkowsky - Why AI Will Kill Us, Aligning LLMs, Nature of Intelligence, SciFi, & Rationality
Related Questions