Dave discusses the importance of staying updated with neural network architectures and the impact of recent ML advancements on business operations. He emphasizes the dual nature of AI progress in both implementation and research, highlighting key breakthroughs like Bert and alpha zero.
