Published Nov 23, 2019

Annotator Bias

Delve into the intricacies of annotator bias with Mor Geva as she unpacks its impact on NLP models, offering insights into how diverse data and refined data collection methods can improve model generalization and accuracy in the face of skewed datasets.

Episode Highlights

Topics covered

Popular Clips

Episode Highlights

Related Episodes

StrategyQA and Big Bench
Answers 383 questions
4 out of 5 Data Scientists Agree
Answers 383 questions
Being Bayesian
Answers 383 questions
Machine Learning Done Wrong
Answers 383 questions
[MINI] Selection Bias
Answers 383 questions
Non-Response Bias
Answers 383 questions
Visualization and Interpretability
Answers 383 questions
Human vs Machine Transcription
Answers 383 questions
Bayesian A/B Testing
Answers 383 questions
Debiasing GPT-3 Job Ads
Answers 383 questions
Evolutionary Computation
Answers 383 questions
Chatbots
Answers 383 questions
Social Networks
Answers 383 questions
Q&A with Kyle
Answers 383 questions
SpanBERT
Answers 383 questions

Dexa/Kyle Polich

Annotator Bias

Topics covered

Popular Clips

Large Models' Numerical Skills

Addressing Data Collection Biases

Maximizing Impact

Smarter Crowdsourcing Choices

Unraveling Model Bias

Machine Learning Biases

Data Bias Impact

Annotator Contribution Insights

Episode Highlights

NLP Model Challenges

Annotator Bias

Improving Data Quality

Related Episodes

StrategyQA and Big Bench

4 out of 5 Data Scientists Agree

Being Bayesian

Machine Learning Done Wrong

[MINI] Selection Bias

Non-Response Bias

Visualization and Interpretability

Human vs Machine Transcription

Bayesian A/B Testing

Debiasing GPT-3 Job Ads

Evolutionary Computation

Chatbots

Social Networks

Q&A with Kyle

SpanBERT

Annotator Bias

Topics covered

Popular Clips

Episode Highlights

NLP Model Challenges

Annotator BiasMor Geva, lead author of a study on annotator bias, discusses how annotator contributions can skew datasets, leading models to learn annotator styles rather than tasks. She suggests refining data collection methods to mitigate these biases and improve model accuracy.

Annotator Bias

Improving Data QualityMor Geva explores smarter crowdsourcing strategies and bias detection practices in natural language understanding datasets. She highlights the importance of managing annotators effectively and detecting biases to improve model performance.

Improving Data Quality

Related Episodes