AI Scaling Insights
Vivek and Tao discuss the challenges of scaling AI models, emphasizing the importance of experimenting to understand the impact of components like vision encoders on performance. Nathan highlights surprising findings on model sizes, showcasing how limitations in medical content pre-training can affect overall system performance.In this clip
From this podcast

The Cognitive Revolution: How AI Changes Everything
Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu
Related Questions
What are the limitations of the vision model in multimodal systems as discussed in the episode Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu and the clip AI Scaling Insights?
What are the limitations of the vision model in multimodal systems as discussed in the episode Google’s Multimodal Med-PaLM with Vivek Natarajan and Tao Tu and the clip AI Scaling Insights?