Sebastian Ruder discusses the recent advancements in Natural Language Processing (NLP) and how it has experienced its own "ImageNet moment" with the release of powerful pretrained models like XLNet. He highlights the rapid pace of improvements and the impact of these models on benchmark tasks in NLP.
