Sparse Neural Networks
Jonathan discusses the concept of sparsity in neural networks and its relation to attention mechanisms. He delves into the challenges and potential benefits of sparse connections on current hardware, shedding light on the efficiency and interpretability of these networks.In this clip
From this podcast
Machine Learning Street Talk (MLST)
The Lottery Ticket Hypothesis with Jonathan Frankle
Related Questions