Network Inductive Priors

Tim and Jonathan discuss how linear mode connectivity influences inductive priors in neural networks, highlighting the importance of loss surface positions and network structures in learning. They explore the implications of linear mode connectivity on dense and sparse networks, revealing differing functional similarities between them.