Novelty Search and Deception
Joel explains that deception can exist without reward mispecification or distribution shift. He discusses how novelty search can circumvent deception by relying on diverging from previous experiences, which is viewed as more reliable than a reward signal. However, he notes that novelty search is not a perfect solution to deception.In this clip
From this podcast

The Gradient
Joel Lehman: Open-Endedness and Evolution through Large Models
Related Questions