Andrew discusses how language models challenge the traditional separation of syntax and semantics, suggesting a potential shift in perspective. He predicts a future where the effectiveness of these models in practical tasks may overshadow philosophical debates on their true meaning.