Future of Language Models
Linus discusses the potential of 32k tokens for language models and the search for more efficient architectures than transformers. He emphasizes the importance of models absorbing information and hints at the rise of alternative models in the near future.In this clip
From this podcast

Unsupervised Learning
Ep 22: Notion AI Engineer Linus Lee: Behind the Scenes of Notion AI
Related Questions