Data Curation Insights
Akshita emphasizes the importance of using publicly accessible data for their project, detailing the meticulous curation process involved. Initial language and quality filters were applied, with a focus on eliminating toxicity and personally identifiable information. Additionally, they employed tools to ensure the dataset remained uncontaminated by existing evaluation benchmarks, maintaining scientific integrity.In this clip
From this podcast
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
OLMo: Everything You Need to Train an Open Source LLM with Akshita Bhagia - 674
Related Questions