Published Sep 21, 2020

Crowdsourced Expertise

Explore the intricacies of crowdsourced data collection and expertise mapping on the Genius platform as Derek Lim uncovers the challenges and innovations in annotation quality assessment, the motivations of expert contributors, and the dynamic user behaviors influenced by competition and time pressure.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

Earthquake Detection with Crowd-sourced Data
Answers 383 questions
Annotator Bias
Answers 383 questions
4 out of 5 Data Scientists Agree
Answers 383 questions
Social Networks
Answers 383 questions
Q&A with Kyle
Answers 383 questions
Visualization and Interpretability
Answers 383 questions
What You Know About Intelligence is Wrong
Answers 383 questions
Evolutionary Computation
Answers 383 questions
StrategyQA and Big Bench
Answers 383 questions
Crowdfunded Board Games
Answers 383 questions
[MINI] Random Forest
Answers 383 questions
Time Series for Good
Answers 383 questions
AI Roundtable
Answers 383 questions
Inclusive Study Group Formation at Scale
Answers 383 questions
What You Know About Intelligence is Wrong (fixed)
Answers 383 questions

Dexa/Kyle Polich

Crowdsourced Expertise

Topics covered

Popular Clips

Future Plans

Data Skeptic Consensus

Data Collection Insights

Exploring Group Theory

Crowdsourced Musical Knowledge

Temporal Dynamics

Motivations of Genius Contributors

Exploring Temporal Dynamics

Unpacking Data Observations

Surprising Insights

Genius Platform Revealed

Dominant Features

Super Experts and IQ Measurement

Custom Feature Engineering

Episode Highlights

Data Collection Challenges

Expert Contributor Analysis

Crowdsourcing Dynamics

Related Episodes

Earthquake Detection with Crowd-sourced Data

Annotator Bias

4 out of 5 Data Scientists Agree

Social Networks

Q&A with Kyle

Visualization and Interpretability

What You Know About Intelligence is Wrong

Evolutionary Computation

StrategyQA and Big Bench

Crowdfunded Board Games

[MINI] Random Forest

Time Series for Good

AI Roundtable

Inclusive Study Group Formation at Scale

What You Know About Intelligence is Wrong (fixed)

Crowdsourced Expertise

Topics covered

Popular Clips

Episode Highlights

Data Collection ChallengesDerek Lim discusses the challenges and innovations in collecting and assessing data from the Genius platform. He highlights the technical hurdles in data collection and the development of metrics to evaluate annotation quality.

Data Collection Challenges

Expert Contributor AnalysisDerek Lim discusses the intricacies of identifying and predicting expertise on the Genius platform. He explores the motivations of contributors and the challenges in mapping super experts within this crowdsourced musical knowledge curation system.

Expert Contributor Analysis

Crowdsourcing DynamicsDerek Lim explores the temporal dynamics of annotations on the Genius platform, revealing unique patterns in user behavior. He discusses how competition and time pressure influence the quality and evolution of these annotations.

Crowdsourcing Dynamics

Related Episodes