Jonathan shares his journey into the lottery ticket hypothesis, sparked by a simple question about the limitations of pruning neural networks only at the end of training. Frustrated by the lack of evidence in deep learning literature, he aimed to test various hypotheses, leading to groundbreaking insights that began with small networks. His curiosity and desire for scientific validation paved the way for significant advancements in understanding neural network efficiency.
