Scaling Bottlenecks
Ethan and Igor discuss the intrinsic scaling bottlenecks in systems, predicting compute as the bottleneck until the 2040s for video and then shifting to data. They also touch on the challenges of aligning human preferences with machine learning for AGI development.In this clip
From this podcast
Machine Learning Street Talk (MLST)
#99 - CARLA CREMER & IGOR KRAWCZUK - X-Risk, Governance, Effective Altruism
Related Questions
How do scaling laws impact AI development as discussed in the episode 20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CEO @ Poolside and the clip Scaling Laws Explained
How do scaling laws impact AI development as discussed in the episode 20VC: Raising $500M To Compete in the Race for AGI | Will Scaling Laws Continue: Is Access to Compute Everything | Will Nvidia Continue To Dominate | The Biggest Bottlenecks in the Race for AGI with Eiso Kant, CEO @ Poolside and the clip Scaling Laws Explained?
Will large language models scale all the way to artificial general intelligence (AGI) as discussed in the episode Demis Hassabis - Scaling, Superhuman AIs, AlphaZero atop LLMs, Rogue Nations Threat and the clip Scaling Hypothesis Insights?