AI Compute Insights

George discusses the cost of training AI models and the shift towards training smaller models for longer periods. Alessio highlights advancements in embeddings and positional embeddings in language models.