Published May 9, 2024

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

AI expert Percy Liang delves into the intricacies of benchmarking language models through the HELM framework, explores the synergy between AI and music, and underscores the significance of transparency and community in open-source AI development.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

Transforming Search with Perplexity AI’s CTO Denis Yarats
Answers 383 questions
Jerome Pesenti — Large Language Models, PyTorch, and Meta
Answers 383 questions
The Power of AI in Search with You.com's Richard Socher
Answers 383 questions
Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih
Answers 383 questions
Reinventing AI Agents with Imbue CEO Kanjun Qiu
Answers 383 questions
Revolutionizing AI Data Management with Jerry Liu, CEO of LlamaIndex
Answers 383 questions
Richard Socher — The Challenges of Making ML Work in the Real World
Answers 383 questions
Operationalizing Machine Learning: Interview with Shreya Shankar
Answers 383 questions
Emily M. Bender — Language Models and Linguistics
Answers 383 questions
How EleutherAI Trains and Releases LLMs: Interview with Stella Biderman
Answers 383 questions
Dave Rogenmoser & Saad Ansari on Growing & Maintaining Jasper AI
Answers 383 questions
Chip Huyen of Claypot AI— ML Research and Production Pipelines
Answers 383 questions
Expert Insights on the Last AI Renaissance: Interview with Sarah Catanzaro of Amplify Partners
Answers 383 questions
Peter Norvig – Singularity Is in the Eye of the Beholder
Answers 383 questions
Harnessing AI for legal practice with CoCounsel’s Jake Heller
Answers 383 questions

Dexa/Gradient Dissent - A Machine Learning Podcast

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Topics covered

Popular Clips

Agents' Challenges

Benchmarking Agents

Open Innovation Platform

AI and Music

Future LM Landscape

Optimizing Model Development

Open Model Transparency

Model Selection Insights

Data Set Transparency

Music AI Connection

Benchmarking Transparency

Model Selection Advice

Open Model Development

Unreliable Systems

Episode Highlights

AI Benchmarking

AI and Music

Open-Source Models

Related Episodes

Transforming Search with Perplexity AI’s CTO Denis Yarats

Jerome Pesenti — Large Language Models, PyTorch, and Meta

The Power of AI in Search with You.com's Richard Socher

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

Reinventing AI Agents with Imbue CEO Kanjun Qiu

Revolutionizing AI Data Management with Jerry Liu, CEO of LlamaIndex

Richard Socher — The Challenges of Making ML Work in the Real World

Operationalizing Machine Learning: Interview with Shreya Shankar

Emily M. Bender — Language Models and Linguistics

How EleutherAI Trains and Releases LLMs: Interview with Stella Biderman

Dave Rogenmoser & Saad Ansari on Growing & Maintaining Jasper AI

Chip Huyen of Claypot AI— ML Research and Production Pipelines

Expert Insights on the Last AI Renaissance: Interview with Sarah Catanzaro of Amplify Partners

Peter Norvig – Singularity Is in the Eye of the Beholder

Harnessing AI for legal practice with CoCounsel’s Jake Heller

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Topics covered

Popular Clips

Episode Highlights

AI BenchmarkingPercy Liang, co-founder of Together AI and Stanford Associate Professor, discusses the development of HELM, a comprehensive framework for evaluating language models. He highlights the importance of transparency, reproducibility, and the challenges of benchmarking in AI.

AI Benchmarking

AI and MusicPercy Liang explores his lifelong passion for music and its intersection with AI. He discusses advancements in AI music generation and the potential for these technologies to enhance human creativity.

AI and Music

Open-Source ModelsPercy Liang discusses the importance of transparency and community involvement in AI development. He highlights the challenges and potential solutions in open-source model development.

Open-Source Models

Related Episodes