640: What I Learned in 2022 — with Jon Krohn (@JonKrohnLearns)

AI Advancements

The year 2022 marked a significant leap in AI with the advancement of foundational large language models. Jon Krohn highlights the unprecedented capabilities of models like GPT-3, which have orders of magnitude more parameters than their predecessors, leading to emergent properties that were not anticipated by their creators 1. These models have demonstrated expert human-level creative capacity across diverse tasks, from generating artwork to engaging in long-form conversational text 1.

The breadth and often human-level capability that these generative models have is mind-blowing.

--- Jon Krohn

Krohn anticipates that the release of next-generation models, such as GPT-4, will further refine these capabilities, making them even more realistic and human-like 2.

   

Cicero's Impact

Meta AI's Cicero model has revolutionized language-based gameplay negotiation, showcasing the extraordinary potential of AI in 2022. Jon Krohn describes Cicero's ability to play the complex game Diplomacy at a high level, forming alliances and strategically outmaneuvering opponents 2. This achievement underscores the human-level quality of AI applications in natural language processing and negotiation tasks.

The Cicero algorithm is able to play diplomacy online at the 90th percentile or higher. That's really mind-blowing to me.

--- Jon Krohn

Krohn is eager to explore further developments in AI models, anticipating even more groundbreaking capabilities in the coming years 2.