Published Feb 22, 2024

Google ships it: Gemma open LLMs and Gemini backlash

Join Nathan Lambert as he delves into Google's latest AI venture with the launch of Gemma, a series of lightweight open language models, discussing the innovative use of reinforcement learning, challenges of AI bias, and pioneering evaluation techniques that set new standards in generative AI.

Episode Highlights

Topics covered

Popular Clips

Episode Highlights

Related Episodes

Releases! OpenAI’s Sora for video, Gemini 1.5's infinite context, and a secret Mistral model
Answers 383 questions
10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more
Answers 383 questions
Big Tech's LLM evals are just marketing
Answers 383 questions
OpenAI chases Her
Answers 383 questions
Local LLMs, some facts some fiction
Answers 383 questions
Llama 3: Scaling open LLMs to AGI
Answers 383 questions
Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education
Answers 383 questions
Open Language Models (OLMos) and the LLM landscape
Answers 383 questions
Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions
Answers 383 questions
The end of the "best open LLM"
Answers 383 questions
Alignment-as-a-Service: Scale AI vs. the new guys
Answers 383 questions
Mixtral: The best open model, MoE trade-offs, release lessons, Mistral raises $400mil, Google's loss, vibes vs marketing
Answers 383 questions
Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem
Answers 383 questions
It's 2024 and they just want to learn
Answers 383 questions
Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents
Answers 383 questions

Dexa/Interconnects Audio

Google ships it: Gemma open LLMs and Gemini backlash

Topics covered

Popular Clips

AI Model Challenges

Reinforcement Learning Evolution

AI Bias and Marketing

Model Evaluations Insights

Reinforcement Learning Insights

Episode Highlights

Reinforcement Learning

AI Bias and Ethics

AI Model Evaluations

Related Episodes

Releases! OpenAI’s Sora for video, Gemini 1.5's infinite context, and a secret Mistral model

10 Sora and Gemini 1.5 follow-ups: code-base in context, deepfakes, pixel-peeping, inference costs, and more

Big Tech's LLM evals are just marketing

OpenAI chases Her

Local LLMs, some facts some fiction

Llama 3: Scaling open LLMs to AGI

Interviewing Sebastian Raschka on the state of open LLMs, Llama 3.1, and AI education

Open Language Models (OLMos) and the LLM landscape

Multimodal LM roundup: Unified IO 2, inputs and outputs, Gemini, LLaVA-RLHF, and RLHF questions

The end of the "best open LLM"

Alignment-as-a-Service: Scale AI vs. the new guys

Mixtral: The best open model, MoE trade-offs, release lessons, Mistral raises $400mil, Google's loss, vibes vs marketing

Llama 3.1 405b, Meta's AI strategy, and the new open frontier model ecosystem

It's 2024 and they just want to learn

Interviewing Ross Taylor on LLM reasoning, Llama fine-tuning, Galactica, agents

Google ships it: Gemma open LLMs and Gemini backlash

Topics covered

Popular Clips

Episode Highlights

Reinforcement Learning

AI Bias and EthicsGoogle's launch of Gemma, an open LLM, highlights ongoing challenges with AI bias and the strategic marketing efforts to address ethical concerns. The initiative underscores the complexity of balancing technological advancement with responsible AI development.

AI Bias and Ethics

AI Model EvaluationsGoogle's release of Gemma, an open language model, showcases advancements in AI model evaluation and training techniques. Nathan Lambert discusses the metrics and strategies that set Gemma apart, highlighting its impact on the landscape of generative AI.

AI Model Evaluations

Related Episodes