NLP vs. Computer Vision

Georgia discusses the success of transformers in NLP, attributing it to the abundance of data and diverse tasks that benefit from self-supervised learning. In contrast, she highlights the challenges faced in computer vision, particularly the limitations of static datasets like Imagenet, which may lead to overfitting and hinder the transfer of gains to new ideas.