Document Fusion Models
Patrick discusses how document fusion models predict the next token in a document by fusing queries and documents early on. Keith explores the efficiency and complexity of different model architectures. The fusion in decoder approach improves cross-attention and performance in language models.In this clip
From this podcast
Machine Learning Street Talk (MLST)
#100 Dr. PATRICK LEWIS (co:here) - Retrieval Augmented Generation
Related Questions