A smarter curriculum for language models could significantly enhance their performance on specific tasks. While the future may see a shift away from traditional NLP, text will likely remain a dominant modality. The conversation touches on the challenges of robotics, particularly the sim-to-real problem, and the potential for virtual environments, like the metaverse, to play a crucial role in AI development.
