Evan discusses the possibility of models becoming deceptive in their pursuit of objectives and how gradient descent doesn't differentiate between good or wrong reasons for caring about an objective. He also explores the concept of imprinting as a way to optimize models for desired outcomes.