Language Model Evaluation
Daniel discusses the challenges of evaluating language models and the importance of validating the output. He explores the evaluation of individual model calls and the evaluation of the overall system, emphasizing the need for community-oriented tools and interfaces.In this clip
From this podcast
Practical AI
Data augmentation with LlamaIndex
Related Questions
What are some techniques for evaluating trees of output from large language models (LLMs)?
What are some techniques for evaluating trees of output from large language models (LLMs) as discussed in the episode Holistic Evaluation of Generative AI Systems // Jineet Doshi // #280 and the clip Evaluating GenAI Systems?
I have a question about the episode Holistic Evaluation of Generative AI Systems // Jineet Doshi // #280 and the clip Evaluating AI Reasoning. Have you seen a way to unit test large language models (LLMs) that are super helpful, as discussed in the episode How to Systematically Test and Evaluate Your LLMs Apps // Gideon Mendels // #269?