A recent release from Google showcases a 2.6 billion parameter open-source AI model that outperforms larger counterparts, including a 7 billion parameter model and GPT 3.5. The surprising Elo score of 1126 has sparked discussions about the validity of performance metrics in AI. The limited data provided by Google raises questions about the overall assessment of AI capabilities in the current landscape.
