Testing NLP Models
Marco discusses the rigorous testing conducted on various NLP models, including those believed to be state-of-the-art. By evaluating models like BERT and commercial offerings from major tech companies, he highlights surprising bugs that challenge the assumption of their reliability. Additionally, a user study demonstrated the effectiveness of their testing process, revealing that even inexperienced testers could uncover issues.In this clip
From this podcast
NLP Highlights
114 - Behavioral Testing of NLP Models, with Marco Tulio Ribeiro
Related Questions