Scaling Ideas

Greg discusses the critical balance between massive computational resources and innovative ideas that can emerge without them. He reflects on the historical development of concepts like GANs and VAEs, emphasizing that impactful ideas often shine brightest when scaled. The conversation also touches on the aspiration for compute resources to be accessible as a utility, allowing researchers to focus on building and deploying systems effectively.