Published Oct 8, 2019

SpanBERT

Explore the innovations of SpanBERT with Omer Levy, highlighting its superior performance in span selection tasks and the advancements in pre-training techniques that outshine BERT, revolutionizing the scalability and democratization of NLP models.

Episode Highlights

Topics covered

Evaluating Performance
01
Impact on NLP
02
SpanBERT Mechanisms
03

Popular Clips

Span Selection Success
Play Clip
SpanBERT Innovations
Play Clip
Scaling AI Models
Play Clip
Model Overfitting Insights
Play Clip
Online Engagement Tips
Play Clip
Advancements in NLP
Play Clip
Masking Techniques
Play Clip
Benchmarking Language Models
Play Clip
Model Training Insights
Play Clip

Episode Highlights

Related Episodes

BERT
Answers 383 questions
BERT is Magic
Answers 383 questions
What BERT is Not
Answers 383 questions
BERT is Shallow
Answers 383 questions
Serverless NLP Model Training
Answers 383 questions
The Limits of NLP
Answers 383 questions
Transfer Learning
Answers 383 questions
ELMo
Answers 383 questions
Annotator Bias
Answers 383 questions
Named Entity Recognition
Answers 383 questions
Bird Distribution Modeling with Satbird
Answers 383 questions
Transfer Learning
Answers 383 questions
NLP for Developers
Answers 383 questions
Cross-lingual Short-text Matching
Answers 383 questions
Being Bayesian
Answers 383 questions

SpanBERT

Topics covered

Popular Clips

Episode Highlights

Evaluating Performance

Impact on NLPOmer Levy discusses the challenges of scaling NLP models like SpanBERT and its impressive performance in specific tasks. He highlights the need for democratizing AI and the advancements SpanBERT brings to span selection tasks.

Impact on NLP

SpanBERT Mechanisms

Related Episodes