Jonathan discusses the lottery ticket hypothesis, exploring the idea of finding sparse networks that optimize well. He touches on the challenges of understanding theoretical papers and the value of theory work in providing new insights for empirical research.