Evolving Landscapes

Joel discusses his changing intuitions about the structure of optimization landscapes and the differences in exploration methods used in deep learning. He also explores the idea of population-based training and the success of large neural networks in supervised and unsupervised learning.