Over Parameterization Debate

Jonathan discusses the necessity of over parameterization in neural networks, questioning its role in the lottery ticket hypothesis. The debate centers around the need for memorizing noisy data and the level of over parameterization required for network generalization.