Learn more
Join Dexa

Exploration in AI

Oriol discusses the complexities of exploration in AI, particularly in real-time strategy games where actions occur at 22 times per second. He emphasizes the challenges of partial observability and the importance of building a robust policy through neural networks. The architecture of AlphaStar is designed to effectively model the game state, allowing the agent to learn and adapt without needing additional components beyond trained weights.