Solving the Labeling Problem
Lukas Biewald discusses the challenges of evaluating job performance in crowdsourcing and the need for a reliable reputation system. He explains how Crowdflower developed technology to automatically determine the quality of work and how it became a preferred platform for ML teams seeking high-quality labeled data.In this clip
From this podcast
The Gradient
Lukas Biewald: Crowdsourcing at CrowdFlower and ML Tooling at Weights & Biases
Related Questions
Is data quality overlooked in machine learning as discussed in the episode AI For Good - Detecting Harmful Content at Scale // Matar Haller // #245 and the clip Data Labeling Insights?
Is data quality overlooked in machine learning?
Do you feel like the vast majority of people in the field discussed in the episode AI Today Podcast: How AI and Project Management Fit Together: Interview with Kendall Lott and Mike Fortezza, PM Point of View Podcast and the clip Trusting Algorithms don't actually know what they're doing but have activated subconscious algorithms that have benefited them in the past?