Published Aug 31, 2023

20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai

Explore AI's transformative potential, startup agility, and the intricacies of model training with Noam Shazeer, Co-Founder & CEO of Character.ai, as he discusses spending $2M on AI models, the nature of AI hallucinations, and raising $150M from a16z, while pondering the future of AI companionship.

Episode Highlights

Topics covered

AI in Society
01
AI versus Incumbents
02
AI Model Training
03

Episode Highlights

Related Episodes

20VC: The Biggest AI Leaders on What Matters More; Model Size or Data Size & Where Does The Value in AI Accrue; to Startups or to Incumbents
Answers 383 questions
20VC: Does Value Accrue to Incumbents or Startups in the AI Race, Why Model Size Matters More Than Data Size, Why Artificial General Intelligence is Far Away, Why Carpenters Will Be Paid More Than Software Engineers & Future of Jobs with Richard Socher
Answers 383 questions
20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI
Answers 383 questions
20VC: Are Foundation Models Becoming Commoditised? Do OpenAI and Anthropic of the World Have a Sustaining Moat? Why Smaller Models May Work Better? Why Incumbents with Data Power Win the AI War with Christian Kleinerman, SVP Product @ Snowflake
Answers 383 questions
20VC: Why AI Models are not a Moat, Where Does the Value in AI Accrue; Startups or Incumbents, What the World Has Got Wrong About AI, Why AI Needs a New Story and Who is the Right People to Tell it with Cris Valenzuela, Co-Founder & CEO @ Runway
Answers 383 questions
20VC: Why the AI Bubble Will Be Bigger Than The Dot Com Bubble, Why AI Will Have a Bigger Impact Than COVID, Why No Models Used Today Will Be Used in a Year, Why All Models are Biased and How AI Kills Traditional Media with Emad Mostaque, Founder & CEO @
Answers 383 questions
20VC: AI's Biggest Questions: The Commoditisation of LLMs, Open vs Closed: Who Wins, Model Size vs Data Quality, Why Google are Vulnerable and Apple are the Dark Horse
Answers 383 questions
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia
Answers 383 questions
20VC: Why The Future of AI Is Open Not Closed, Why We Are Years Away From AI Being Autonomous, Why AI Founders Do Not Need to Move to the Valley & Why Founders Should Not Meet Investors in Between Rounds with Clem Delangue @ Hugging Face
Answers 383 questions
20VC: Is More Compute the Answer to Model Performance | Why OpenAI Abandons Products, The Biggest Opportunities They Have Not Taken & Analysing Their Race for AGI | What Companies, AI Labs and Startups Get Wrong About AI with Ethan Mollick
Answers 383 questions
20VC: The OpenAI Memo: Why Invest? Is it too Late to Catch OpenAI? Are OpenAI's Models Truly Defensible? Does the Value in AI Accrue to Incumbemts or Startups - Application Layer/Infrastructure? What Happens with Regulation? with Vince Hankes @ Thrive
Answers 383 questions
20VC: Chips, Models or Applications; Where is the Value in AI | Is Compute the Answer to All Model Performance Questions | Why Open AI Shelved AGI & Is There Any Value in Models with OpenAI Price Dumping with Aidan, Gomez, Co-Founder @ Cohere
Answers 383 questions
20VC: Scale's Alex Wang on Why Data Not Compute is the Bottleneck to Foundation Model Performance, Why AI is the Greatest Military Asset Ever, Is China Really Two Years Behind the US in AI and Why the CCPs Industrial Approach is Better than Anyone Else's
Answers 383 questions
20VC: Bret Taylor: The AI Bubble and What Happens Now | How the Cost of Chips and Models Will Change in AI | Will Companies Build Their Own Software | Why Pre-Training is for Morons | Leaderships Lessons from Mark Zuckerberg
Answers 383 questions
20VC: Why Foundation Model Performance is Not Diminishing But Models Are Commoditising, Why Nvidia Will Enter the Model Space and Models Will Enter the Chip Space & The Right Business Model for AI Software with David Luan, Co-Founder @ Adept
Answers 383 questions

Dexa/Harry Stebbings

20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai

Topics covered

Popular Clips

AI's Future Insights

Cost Savings Solutions

Proprietary Data Insights

CEO vs. Parenthood

Neural Language Modeling

Startup Agility

Human Connection Insights

High-Yield Treasury Accounts

Google's Impact

Vision and Mission

Deep Learning Misconceptions

AI Community Insights

AI Innovation Drive

Employee Rewards Program

Episode Highlights

AI in Society

AI versus Incumbents

AI Model Training

Related Episodes

20VC: The Biggest AI Leaders on What Matters More; Model Size or Data Size & Where Does The Value in AI Accrue; to Startups or to Incumbents

20VC: Does Value Accrue to Incumbents or Startups in the AI Race, Why Model Size Matters More Than Data Size, Why Artificial General Intelligence is Far Away, Why Carpenters Will Be Paid More Than Software Engineers & Future of Jobs with Richard Socher

20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI

20VC: Are Foundation Models Becoming Commoditised? Do OpenAI and Anthropic of the World Have a Sustaining Moat? Why Smaller Models May Work Better? Why Incumbents with Data Power Win the AI War with Christian Kleinerman, SVP Product @ Snowflake

20VC: Why AI Models are not a Moat, Where Does the Value in AI Accrue; Startups or Incumbents, What the World Has Got Wrong About AI, Why AI Needs a New Story and Who is the Right People to Tell it with Cris Valenzuela, Co-Founder & CEO @ Runway

20VC: Why the AI Bubble Will Be Bigger Than The Dot Com Bubble, Why AI Will Have a Bigger Impact Than COVID, Why No Models Used Today Will Be Used in a Year, Why All Models are Biased and How AI Kills Traditional Media with Emad Mostaque, Founder & CEO @

20VC: AI's Biggest Questions: The Commoditisation of LLMs, Open vs Closed: Who Wins, Model Size vs Data Quality, Why Google are Vulnerable and Apple are the Dark Horse

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

20VC: Why The Future of AI Is Open Not Closed, Why We Are Years Away From AI Being Autonomous, Why AI Founders Do Not Need to Move to the Valley & Why Founders Should Not Meet Investors in Between Rounds with Clem Delangue @ Hugging Face

20VC: Is More Compute the Answer to Model Performance | Why OpenAI Abandons Products, The Biggest Opportunities They Have Not Taken & Analysing Their Race for AGI | What Companies, AI Labs and Startups Get Wrong About AI with Ethan Mollick

20VC: The OpenAI Memo: Why Invest? Is it too Late to Catch OpenAI? Are OpenAI's Models Truly Defensible? Does the Value in AI Accrue to Incumbemts or Startups - Application Layer/Infrastructure? What Happens with Regulation? with Vince Hankes @ Thrive

20VC: Chips, Models or Applications; Where is the Value in AI | Is Compute the Answer to All Model Performance Questions | Why Open AI Shelved AGI & Is There Any Value in Models with OpenAI Price Dumping with Aidan, Gomez, Co-Founder @ Cohere

20VC: Scale's Alex Wang on Why Data Not Compute is the Bottleneck to Foundation Model Performance, Why AI is the Greatest Military Asset Ever, Is China Really Two Years Behind the US in AI and Why the CCPs Industrial Approach is Better than Anyone Else's

20VC: Bret Taylor: The AI Bubble and What Happens Now | How the Cost of Chips and Models Will Change in AI | Will Companies Build Their Own Software | Why Pre-Training is for Morons | Leaderships Lessons from Mark Zuckerberg

20VC: Why Foundation Model Performance is Not Diminishing But Models Are Commoditising, Why Nvidia Will Enter the Model Space and Models Will Enter the Chip Space & The Right Business Model for AI Software with David Luan, Co-Founder @ Adept

20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai

Topics covered

Popular Clips

Episode Highlights

AI in SocietyNoam Shazeer discusses AI's potential to enhance human connections and its rapidly evolving future. He shares insights on AI's role in society and the challenges within the AI community.

AI in Society

AI versus Incumbents

AI Model TrainingNoam Shazeer, co-founder of Character.AI, discusses the financial and computational challenges in AI model training. He emphasizes the importance of model size and the need for advanced hardware to enhance AI capabilities.

AI Model Training

Related Episodes