Jeremy discusses the impressive results achieved with NLP transfer learning techniques, particularly in non-English languages, highlighting recent successes in Polish, German, and Thai. He emphasizes the ease of use of the library for tabular datasets and the potential for self-supervised learning, which utilizes input data to generate labels, paving the way for more effective transfer learning without the need for explicit labels.
