Observability for LLMs
The discussion highlights the current challenges in observability for large language models, particularly the need for better automatic instrumentation and the difficulties associated with high cardinality data. As users explore these models, they are encouraged to experiment and innovate, turning creative ideas into practical applications. The future promises advancements in best practices, especially as demand grows in 2024.In this clip
From this podcast
Software Engineering Radio - the podcast for professional software developers
SE Radio 610: Phillip Carter on Observability for Large Language Models
Related Questions
What is the future of large language models (LLMs) as discussed in the episode SE Radio 610: Phillip Carter on Observability for Large Language Models and the clip Language Models Explained?
What is the main topic of the clip "Observability in Systems" from the episode SE Radio 610: Phillip Carter on Observability for Large Language Models?
What is the main topic of the clip "Observability in Systems" from the episode SE Radio 610: Phillip Carter on Observability for Large Language Models?