Benchmarking Agents
Percy discusses benchmarking agents and language models within agent systems, emphasizing the importance of challenging datasets. He highlights the ML agent bench as a tool for evaluating language models in solving ML engineering tasks, showcasing the potential for improving ML systems in the future.In this clip
From this podcast
Gradient Dissent - A Machine Learning Podcast
Shaping AI Benchmarks with Together AI Co-Founder Percy Liang
Related Questions