Breakthroughs in AI
Dwarkesh Patel and Ilya Sutskever discuss the possibility of future breakthroughs in AI, with Patel suggesting that they may not feel like breakthroughs in hindsight. Sutskever highlights the importance of conceptual breakthroughs, using the example of the transformer, which was not initially obvious to many. They also touch on the forward algorithm as an attempt to train neural networks without backpropagation.In this clip
From this podcast
Dwarkesh Podcast
Ilya Sutskever (OpenAI Chief Scientist) - Building AGI, Alignment, Spies, Microsoft, & Enlightenment
Related Questions