AI Pathways Revolution
Nathan and Vivek delve into the concept of Pathways, a large-scale ML orchestration system that optimizes training giant models on thousands of accelerator chips. They discuss the magic behind Jax XLA and TPUs, emphasizing the co-optimization with hardware that enables effective training of transformer models at scale.In this clip
From this podcast
The Cognitive Revolution: How AI Changes Everything
Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu
Related Questions