Adrien discusses the inevitability and effectiveness of deep learning in improving perception tasks, emphasizing the challenges of robust perception and the necessity to go beyond current solutions. The conversation delves into the complexities of uncertainty modeling and the leakiness of every abstraction in machine learning.