Christopher discusses the historical context of linguistics, highlighting the ambitious goal of discovering linguistic structures from texts. He contrasts this with Chomsky's skepticism about learning language structure from observed evidence, emphasizing that large language models demonstrate the possibility of learning human language structures, challenging long-held beliefs in the field.