Novelty Search and Deception

Joel explains that deception can exist without reward mispecification or distribution shift. He discusses how novelty search can circumvent deception by relying on diverging from previous experiences, which is viewed as more reliable than a reward signal. However, he notes that novelty search is not a perfect solution to deception.