Published Jan 5, 2024
Where 2024’s “open GPT4” can’t match OpenAI’s
Nathan Lambert delves into the intricacies of language model evaluation and development, contrasting open-source projects with proprietary advancements, and explores the transformative potential of reinforcement learning from human feedback (RLHF) in shaping AI capabilities and commercial products.
Topics covered
Popular Clips
Episode Highlights
Related Episodes
OpenAI chases Her
Answers 383 questionsGPT-4o-mini changed ChatBotArena
Answers 383 questionsIt's 2024 and they just want to learn
Answers 383 questionsOpenAI's Model (behavior) Spec, RLHF transparency, and personalization questions
Answers 383 questionsOpen Language Models (OLMos) and the LLM landscape
Answers 383 questions
Reverse engineering OpenAI's o1
Answers 383 questionsBig Tech's LLM evals are just marketing
Answers 383 questionsA realistic path to robotic foundation models
Answers 383 questionsWhy we disagree on what open-source AI should be
Answers 383 questionsThe end of the "best open LLM"
Answers 383 questionsGoogle ships it: Gemma open LLMs and Gemini backlash
Answers 383 questionsLlama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem
Answers 383 questions
