Curiosity in Algorithms

The challenge of instilling human-like curiosity in algorithms is explored, highlighting the pitfalls of defining "interesting" in a mathematical context. When agents are programmed to seek new states, they may fixate on trivial stimuli, such as a TV, rather than pursuing genuinely interesting experiences. This underscores the complexity of creating intrinsically motivated systems that truly understand what it means to explore and learn effectively.