SDS 569: A.I. For Crushing Humans at Poker and Board Games — with Noam Brown

Modeling Games

Noam Brown's work in AI modeling for games like poker and diplomacy highlights the importance of understanding human behavior. He emphasizes the need for data to model human actions effectively, allowing AI to adapt to different styles and contexts 1. This adaptability is crucial as AI competes against top human players, leading to significant shifts in professional gaming careers. Brown notes, "A lot of when we were doing this competition, we made this AI. We played it against these top professional poker players. And at the end of the competition, they were coming to me for career advice because they are realizing, like, oh, you know, our days are numbered as professional poker players."

A lot of when we were doing this competition, we made this AI. We played it against these top professional poker players. And at the end of the competition, they were coming to me for career advice because they are realizing, like, oh, you know, our days are numbered as professional poker players.

--- Noam Brown

Brown also shares insights from his research on negotiation, highlighting the importance of understanding human elements beyond rational behavior 2.

   

Real-World AI

The application of AI modeling techniques extends beyond games to real-world challenges, such as self-driving cars. Brown explains that while games have well-defined environments and outcomes, real-world scenarios are more complex and unpredictable 3. He highlights the potential of AI to model human behavior in various contexts, which is essential for developing AI systems that can collaborate with humans. "The big challenge with self-driving cars is modeling the behavior of other humans on the road," Brown states, emphasizing the need for AI to understand human quirks and conventions.

The big challenge with self-driving cars is modeling the behavior of other humans on the road.

--- Noam Brown

Brown's research on cooperative games and imperfect information games aims to bridge the gap between AI and real-world applications, with promising results in areas like diplomacy and card games 4.