Hyperparameter Dynamics
Tom discusses the impact of adding a new hyperparameter to the architecture and how it affects the learning dynamics in different games. Tim explores the idea of using neural networks as proxies for non-differentiable parameters in meta learning, highlighting the complexity it introduces to the system.In this clip
From this podcast
Machine Learning Street Talk (MLST)
#49 - Meta-Gradients in RL - Dr. Tom Zahavy (DeepMind)
Related Questions