Lexmert vs. Competitors
Waleed and Hao delve into the distinctions between Lexmert and other multimodal transformers like Vrbird and Visual Bert, highlighting differences in datasets, model architecture, and pre-training methods. Hao emphasizes that these variations contribute to Lexmert's superior performance on overlapping datasets. Mohit adds that while later works have expanded Lexmert's capabilities, the focus should shift towards enhancing generalization and unimodal improvements.In this clip
From this podcast
NLP Highlights
107 - Multi-Modal Transformers, with Hao Tan and Mohit Bansal
Related Questions