Published Jun 30, 2023

20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI

Douwe Kiela, Co-Founder of Contextual AI, delves into the essential role of data size in AI over model size, challenges EU's AI regulatory approach, and discusses the interplay of philosophy and AI, advocating for practical applications and collaboration in the field.

Episode Highlights

Topics covered

Philosophy and AI
01
AI Regulation Challenges
02
AI and Data Models
03

Episode Highlights

Related Episodes

20VC: The Biggest AI Leaders on What Matters More; Model Size or Data Size & Where Does The Value in AI Accrue; to Startups or to Incumbents
Answers 383 questions
20VC: Does Value Accrue to Incumbents or Startups in the AI Race, Why Model Size Matters More Than Data Size, Why Artificial General Intelligence is Far Away, Why Carpenters Will Be Paid More Than Software Engineers & Future of Jobs with Richard Socher
Answers 383 questions
20VC: Why No Models Today Will Be Used in a Year, Why Open Will Always Beat Closed in AI, Why Proprietary Data is Less Important Than Ever And Why EU AI Regulation is a Disaster with Alex Lebrun, Founder & CEO @ Nabla
Answers 383 questions
20VC: Are Foundation Models Becoming Commoditised? Do OpenAI and Anthropic of the World Have a Sustaining Moat? Why Smaller Models May Work Better? Why Incumbents with Data Power Win the AI War with Christian Kleinerman, SVP Product @ Snowflake
Answers 383 questions
20VC: Why The Future of AI Is Open Not Closed, Why We Are Years Away From AI Being Autonomous, Why AI Founders Do Not Need to Move to the Valley & Why Founders Should Not Meet Investors in Between Rounds with Clem Delangue @ Hugging Face
Answers 383 questions
20VC: Yann LeCun on Why Artificial Intelligence Will Not Dominate Humanity, Why No Economists Believe All Jobs Will Be Replaced by AI, Why the Size of Models Matters Less and Less & Why Open Models Beat Closed Models
Answers 383 questions
20VC: AI's Biggest Questions: The Commoditisation of LLMs, Open vs Closed: Who Wins, Model Size vs Data Quality, Why Google are Vulnerable and Apple are the Dark Horse
Answers 383 questions
20VC: Why AI Models are not a Moat, Where Does the Value in AI Accrue; Startups or Incumbents, What the World Has Got Wrong About AI, Why AI Needs a New Story and Who is the Right People to Tell it with Cris Valenzuela, Co-Founder & CEO @ Runway
Answers 383 questions
20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai
Answers 383 questions
20VC: Why OpenAI Will Become an Infrastructure Play, Why Apple Will Win in an AI World, Why Google is the Most Vulnerable Incumbent, Will LLMs Be Commoditised, Which Startups Are Thin vs Thick Wrappers on Top of LLMs with Jeff Seibert, Founder @ Digits
Answers 383 questions
20VC: Why the AI Bubble Will Be Bigger Than The Dot Com Bubble, Why AI Will Have a Bigger Impact Than COVID, Why No Models Used Today Will Be Used in a Year, Why All Models are Biased and How AI Kills Traditional Media with Emad Mostaque, Founder & CEO @
Answers 383 questions
20VC: Why Too Many People Give Up Too Quickly, Why You Should Never Start A Venture Without Owning The Underlying Data & Why We Have Over-Estimated The Ability of Automation with Dennis Mortensen, Founder & CEO @ X.ai
Answers 383 questions
20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia
Answers 383 questions
20VC: Why Scaling Laws Will Not Continue | OpenAI vs Anthropic vs X.ai: Who Wins and Why | How Far Will Model Providers Go Into the Application Layer | The End State for Models: Many Specialised or Few Generalised with Victor Riparbelli @ Synthesia
Answers 383 questions
20VC: In AI Who Wins? Startups or Incumbents? What Happens to Wealth Inequality? Why Will $10BN+ Companies Only Have 10 People | Why Defensibility in Startups is BS & Speed is Everything? Why Large Groups Worsen Decision-Making with Sarah Guo
Answers 383 questions

Dexa/Harry Stebbings

20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI

Topics covered

Popular Clips

Financial Tools for Startups

Financial Tools for Founders

Data Acquisition Insights

VC Funding Trends

Scaling AI Insights

Data's Crucial Role

Startup Model Evolution

Regulation and Innovation

Revolutionize Your Workflow

Journey into NLP

Bridging the Knowledge Gap

Evaluating AI Models

Exciting Conversations

Episode Highlights

Philosophy and AI

AI Regulation Challenges

AI and Data Models

Related Episodes

20VC: The Biggest AI Leaders on What Matters More; Model Size or Data Size & Where Does The Value in AI Accrue; to Startups or to Incumbents

20VC: Does Value Accrue to Incumbents or Startups in the AI Race, Why Model Size Matters More Than Data Size, Why Artificial General Intelligence is Far Away, Why Carpenters Will Be Paid More Than Software Engineers & Future of Jobs with Richard Socher

20VC: Why No Models Today Will Be Used in a Year, Why Open Will Always Beat Closed in AI, Why Proprietary Data is Less Important Than Ever And Why EU AI Regulation is a Disaster with Alex Lebrun, Founder & CEO @ Nabla

20VC: Are Foundation Models Becoming Commoditised? Do OpenAI and Anthropic of the World Have a Sustaining Moat? Why Smaller Models May Work Better? Why Incumbents with Data Power Win the AI War with Christian Kleinerman, SVP Product @ Snowflake

20VC: Why The Future of AI Is Open Not Closed, Why We Are Years Away From AI Being Autonomous, Why AI Founders Do Not Need to Move to the Valley & Why Founders Should Not Meet Investors in Between Rounds with Clem Delangue @ Hugging Face

20VC: Yann LeCun on Why Artificial Intelligence Will Not Dominate Humanity, Why No Economists Believe All Jobs Will Be Replaced by AI, Why the Size of Models Matters Less and Less & Why Open Models Beat Closed Models

20VC: AI's Biggest Questions: The Commoditisation of LLMs, Open vs Closed: Who Wins, Model Size vs Data Quality, Why Google are Vulnerable and Apple are the Dark Horse

20VC: Why AI Models are not a Moat, Where Does the Value in AI Accrue; Startups or Incumbents, What the World Has Got Wrong About AI, Why AI Needs a New Story and Who is the Right People to Tell it with Cris Valenzuela, Co-Founder & CEO @ Runway

20VC: Spending $2M to Train a Single AI Model: What Matters More; Model Size or Data Size | Hallucinations: Feature or Bug | Will Everyone Have an AI Friend in the Future & Raising $150M from a16z with Noam Shazeer, Co-Founder & CEO @ Character.ai

20VC: Why OpenAI Will Become an Infrastructure Play, Why Apple Will Win in an AI World, Why Google is the Most Vulnerable Incumbent, Will LLMs Be Commoditised, Which Startups Are Thin vs Thick Wrappers on Top of LLMs with Jeff Seibert, Founder @ Digits

20VC: Why the AI Bubble Will Be Bigger Than The Dot Com Bubble, Why AI Will Have a Bigger Impact Than COVID, Why No Models Used Today Will Be Used in a Year, Why All Models are Biased and How AI Kills Traditional Media with Emad Mostaque, Founder & CEO @

20VC: Why Too Many People Give Up Too Quickly, Why You Should Never Start A Venture Without Owning The Underlying Data & Why We Have Over-Estimated The Ability of Automation with Dennis Mortensen, Founder & CEO @ X.ai

20VC: Why All AI Companies Are Under-Valued | The Future of Foundation Models: Scaling Laws, Generalised vs Specialised, Commoditised? | From Unable to Afford Rent to Raising $130M From Index and Peter Thiel with George Sivulka @ Hebbia

20VC: Why Scaling Laws Will Not Continue | OpenAI vs Anthropic vs X.ai: Who Wins and Why | How Far Will Model Providers Go Into the Application Layer | The End State for Models: Many Specialised or Few Generalised with Victor Riparbelli @ Synthesia

20VC: In AI Who Wins? Startups or Incumbents? What Happens to Wealth Inequality? Why Will $10BN+ Companies Only Have 10 People | Why Defensibility in Startups is BS & Speed is Everything? Why Large Groups Worsen Decision-Making with Sarah Guo

20VC: Why Data Size Matters More Than Model Size, Why The Google Employee Was Wrong; OpenAI and Google Have the Advantage & Why Open Source is Not Going to Win with Douwe Kiela, Co-Founder @ Contextual AI

Topics covered

Popular Clips

Episode Highlights

Philosophy and AIDouwe Kiela explores the intersection of philosophy and AI, highlighting how philosophical concepts enhance AI research. He shares insights from his career, emphasizing the importance of practical applications and collaboration in AI development.

Philosophy and AI

AI Regulation Challenges

AI and Data ModelsDouwe Kiela, CEO of Contextual AI, emphasizes the critical role of data size over model size in AI development. He explores the advantages of proprietary data and the importance of separating data and model planes for privacy and control.

AI and Data Models

Related Episodes