Data Set Challenges

Kyle discusses the challenges of working with a small corpus of labeled data for industrial scale systems in natural language processing. The guest explains the nature of questions from Alibaba and the historical approaches to short text matching. The importance of translations in the data set for English and Spanish pairs is highlighted.