Scaling LLMs

Waleed discusses the barriers to using LLMs, highlighting the major issue of cost. He explains that serving a fine-tuned model from OpenAI can be quite expensive, and even rolling your own LLMs requires substantial resources.

In this clip
From this podcast
MLOps.community
ML Scalability Challenges // Waleed Kadous // MLOps Podcast # 154
Related Questions
- How much does hardware for large language models (LLMs) cost?
- What challenges are faced in training large language models (LLMs)?