This Week in ML & AI avatar

Dexa/This Week in ML & AI

Learn more
Published May 22, 2023

Language Modeling With State Space Models with Dan Fu - 630

PhD student Dan Fu delves into the future of language modeling by examining state space models as a promising alternative to traditional attention mechanisms, focusing on their potential to extend context length and enhance computational efficiency, while introducing innovations like Flash Attention for more feasible GPU training.
Episode Highlights
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) logo

Topics covered

Popular Clips

Episode Highlights

Related Episodes