Scaling Intelligence
Gwern shares his transformative experience with the release of GPT-2 and the monumental leap to GPT-3, highlighting the significance of scaling in neural networks. He critiques the broader AI discourse of 2020, pointing out that many missed crucial insights about scaling laws and their implications, which were evidenced by groundbreaking research that demonstrated the continuous potential of AI advancements.In this clip
From this podcast
Dwarkesh Podcast
Gwern Branwen - How an Anonymous Researcher Predicted AI's Trajectory
Related Questions