Leaderboard Pitfalls

Matt and Siva discuss the limitations of leaderboards in NLP, emphasizing how they prioritize surface-level comparisons over scientific inquiry. They highlight the challenge of relying on leaderboards to address specific research questions, advocating for a deeper understanding beyond mere rankings.