The discussion highlights how deep learning reduces the complexity of engineering processes by minimizing the need for feature engineering. The introduction of entity embeddings allows for seamless integration of categorical and continuous variables across various applications. FastAI's new library aims to democratize deep learning, making it accessible to a broader audience by requiring less coding knowledge.