Published Sep 12, 2023

713: Llama 2, Toolformer and BLOOM: Open-Source LLMs — with Meta's Dr. Thomas Scialom

Join AI expert Dr. Thomas Scialom and host Jon Krohn as they delve into the advancements and challenges in developing open-source language models like Llama 2, exploring its transformative potential and ethical implications in AI research. Discover how the Toolformer project amplifies LLM capabilities through integration with external tools, expanding the horizon for Artificial General Intelligence.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

824: Llama 3.2: Open-Source Edge and Multimodal LLMs — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions
702: Llama 2 — It's Time to Upgrade your Open-Source LLM — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions
806: Llama 3.1 405B: The First Open-Source Frontier LLM — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions
787: MLOps: The Job and The Key Tools — with Demetrios Brinkmann
Answers 383 questions
707: Vicuña, Gorilla, Chatbot Arena and Socially Beneficial LLMs — with Prof. Joey Gonzalez
Answers 383 questions
767: Open-Source LLM Libraries and Techniques — with Dr. Sebastian Raschka
Answers 383 questions
670: LLaMA: GPT-3 performance, 10x smaller — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions
672: Open-source "ChatGPT": Alpaca, Vicuña, GPT4All-J, and Dolly 2.0 — with @JonKrohnLearns
Answers 383 questions
679: The A.I. and Machine Learning Landscape — with investor George Mathew
Answers 383 questions
712: Code Llama — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions
695: NLP with Transformers — with Hugging Face's Lewis Tunstall
Answers 383 questions
733: OpenAssistant: The Open-Source ChatGPT Alternative — with Dr. @YannicKilcher
Answers 383 questions
754: A Code-Specialized LLM Will Realize AGI — with Jason Warner
Answers 383 questions
686: Open-Source "Responsible A.I." Tools — with Ruth Yakubu
Answers 383 questions
772: In Case You Missed It in March 2024 — with Jon Krohn (@JonKrohnLearns)
Answers 383 questions

Dexa/Super Data Science: ML & AI Podcast with Jon Krohn

713: Llama 2, Toolformer and BLOOM: Open-Source LLMs — with Meta's Dr. Thomas Scialom

Topics covered

Popular Clips

Llama Project Insights

Problem-Solving Focus

Open Source Innovations

Language Models in Science

Fine Tuning Insights

AGI and Scaling

Shifting AI Perspectives

Llama Two Insights

Model Safety Insights

Embracing the Unexpected

Managing AI Projects

Predicting AI Trends

Open Source Safety

Llama 2 Insights

Episode Highlights

Artificial General Intelligence

Toolformer and Tools Integration

Open-Source Models

Llama 2 Development

Related Episodes

824: Llama 3.2: Open-Source Edge and Multimodal LLMs — with Jon Krohn (@JonKrohnLearns)

702: Llama 2 — It's Time to Upgrade your Open-Source LLM — with Jon Krohn (@JonKrohnLearns)

806: Llama 3.1 405B: The First Open-Source Frontier LLM — with Jon Krohn (@JonKrohnLearns)

787: MLOps: The Job and The Key Tools — with Demetrios Brinkmann

707: Vicuña, Gorilla, Chatbot Arena and Socially Beneficial LLMs — with Prof. Joey Gonzalez

767: Open-Source LLM Libraries and Techniques — with Dr. Sebastian Raschka

670: LLaMA: GPT-3 performance, 10x smaller — with Jon Krohn (@JonKrohnLearns)

672: Open-source "ChatGPT": Alpaca, Vicuña, GPT4All-J, and Dolly 2.0 — with @JonKrohnLearns

679: The A.I. and Machine Learning Landscape — with investor George Mathew

712: Code Llama — with Jon Krohn (@JonKrohnLearns)

695: NLP with Transformers — with Hugging Face's Lewis Tunstall

733: OpenAssistant: The Open-Source ChatGPT Alternative — with Dr. @YannicKilcher

754: A Code-Specialized LLM Will Realize AGI — with Jason Warner

686: Open-Source "Responsible A.I." Tools — with Ruth Yakubu

772: In Case You Missed It in March 2024 — with Jon Krohn (@JonKrohnLearns)

713: Llama 2, Toolformer and BLOOM: Open-Source LLMs — with Meta's Dr. Thomas Scialom

Topics covered

Popular Clips

Episode Highlights

Artificial General IntelligenceThe potential for achieving Artificial General Intelligence (AGI) is both intriguing and unpredictable. Thomas Scialom and Jon Krohn explore how rapid advancements in AI, like GPT-4 and Llama 2, challenge our understanding of AGI's timeline and capabilities.

Artificial General Intelligence

Toolformer and Tools Integration

Open-Source ModelsThomas Scialom, an AI Research Scientist at Meta, discusses the transformative impact of open-source LLMs like Llama 2 on the research community and industry. He addresses the ethical challenges and safety measures necessary for responsible use of these powerful tools.

Open-Source Models

Llama 2 DevelopmentThomas Scialom discusses the challenges and future plans for Llama 2, focusing on development hurdles and upcoming enhancements. He highlights the balance between rapid development and comprehensive capabilities, as well as the integration of tools to improve the model's utility.

Llama 2 Development

Related Episodes