Why Your GPUs Only Run at 10%! - CentML CEO Explains

Topics covered
Popular Clips
Questions from this episode
- Asked by 136 people
- Asked by 133 people
- Asked by 113 people
- Asked by 109 people
- Asked by 103 people
- Asked by 90 people
- Asked by 88 people
- Asked by 85 people
- Asked by 77 people
- Asked by 72 people
- Asked by 65 people
- Asked by 65 people
- Asked by 59 people
- Asked by 59 people
Episode Highlights
Agentic Systems
Agentic systems in AI are gaining traction, with many startups exploring their potential. highlights the importance of these systems in reducing human intervention, allowing AI to operate more autonomously. He notes that while fine-tuning models is costly, the integration of agentic systems could streamline processes and enhance efficiency 1. However, enterprise adoption remains slow, as many companies are still in the experimental phase 2. states:
It's exciting. It's still a lot to be proven on how it will be used in real examples.
---
The potential for these systems to revolutionize AI integration is significant, but widespread implementation is yet to be seen.
  Â
Multi-Cloud Optimization
Optimizing AI systems across multiple cloud environments presents both challenges and opportunities. explains that while multi-cloud setups are technically feasible, they require careful management of communication costs and infrastructure integration 3. He emphasizes the importance of maintaining neutrality among cloud providers to ensure optimal performance and cost-effectiveness 4. remarks:
We want to get the best performance for the lowest possible cost.
---
By leveraging containerization and maintaining strong partnerships with various cloud providers, companies can achieve scalable and efficient AI deployments.
Related Episodes


Prof. Melanie Mitchell 2.0 - AI Benchmarks are Broken!
Answers 383 questions

#57 - Prof. Melanie Mitchell - Why AI is harder than we think
Answers 383 questions

Bold AI Predictions From Cohere Co-founder
Answers 383 questions

Can We Develop Truly Beneficial AI? George Hotz and Connor Leahy
Answers 383 questions

Explainability, Reasoning, Priors and GPT-3
Answers 383 questions

#032- Simon Kornblith / GoogleAI - SimCLR and Paper Haul!
Answers 383 questions

Gary Marcus' keynote at AGI-24
Answers 383 questions

#046 The Great ML Stagnation (Mark Saroufim and Dr. Mathew Salvaris)
Answers 383 questions

Eliezer Yudkowsky and Stephen Wolfram on AI X-risk
Answers 383 questions

Pattern Recognition vs True Intelligence - Francois Chollet
Answers 383 questions
#65 Prof. PEDRO DOMINGOS [Unplugged]
Answers 383 questions

Francois Chollet - On the Measure of Intelligence
Answers 383 questions

Jurgen Schmidhuber on Humans co-existing with AIs
Answers 383 questions

#80 AIDAN GOMEZ [CEO Cohere] - Language as Software
Answers 383 questions

Sara Hooker - Why US AI Act Compute Thresholds Are Misguided
Answers 383 questions
