The discussion explores the intriguing relationship between hierarchical reinforcement learning and curriculum learning. Curriculum learning can facilitate the development of a hierarchy by allowing agents to learn options sequentially, enhancing their action space. However, learning multiple tasks simultaneously in hierarchical RL can slow down the agent, raising questions about the balance between efficiency and complexity in training.
