Theory vs. Practice

The conversation delves into the notion that practical advancements often outpace theoretical explanations in deep learning, likening it to historical examples like the steam engine and optics. Yann argues that while some may view deep learning as mere alchemy, it reflects a common pattern where technology emerges first, prompting scientific inquiry that leads to broader theories. This dynamic illustrates how engineering can precede and inspire scientific understanding, ultimately shaping foundational principles in various fields.