Jonathan and Carolina explore the intricacies of the lottery ticket hypothesis and its relationship with stochastic gradient descent (SGD) noise. They discuss innovative approaches to measuring SGD noise by focusing on the outcomes of optimization rather than relying on gradient magnitudes. The conversation highlights the evolution of their research, including the challenges faced during the paper's acceptance process and the importance of clear communication in complex topics.
