Published Jul 31, 2024
GPT-4o-mini changed ChatBotArena
Nathan Lambert dives into the transformative impact of GPT-4o-mini on Chatbot Arena and evaluates the performance of Llama 3.1, while exploring challenges and solutions in language model evaluation.
Topics covered
Popular Clips
Episode Highlights
Related Episodes
Llama 3: Scaling open LLMs to AGI
Answers 383 questionsLlama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem
Answers 383 questionsWhere 2024’s “open GPT4” can’t match OpenAI’s
Answers 383 questionsOpenAI chases Her
Answers 383 questions
A recipe for frontier model post-training
Answers 383 questionsLlama 3.2 Vision and Molmo: Foundations for the multimodal open-source ecosystem
Answers 383 questions
Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents
Answers 383 questionsOpen Language Models (OLMos) and the LLM landscape
Answers 383 questionsSwitched to Claude 3.5
Answers 383 questionsGoogle ships it: Gemma open LLMs and Gemini backlash
Answers 383 questionsPhi 3 and Arctic: Outlier LMs are hints
Answers 383 questionsText-to-video AI is already abundant
Answers 383 questionsThe koan of an open-source LLM
Answers 383 questions
