Loss Function Impact
Simon discusses how different loss functions affect network layers differently, with the last third influencing the penultimate layer while the first two thirds learn general features. This insight sheds light on transfer learning success.In this clip
From this podcast

Machine Learning Street Talk (MLST)
#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!
Related Questions
What is the role of loss functions in machine learning as discussed in the episode 819: PyTorch: From Zero to Hero — with Luka Anicin and the clip Neural Network Dynamics?
What is the role of loss functions in machine learning as discussed in the episode 819: PyTorch: From Zero to Hero — with Luka Anicin and the clip Deep Learning Dynamics?
What is the role of loss functions in machine learning?