Mosaic Pretrained Transformer
Naveen discusses the release of the Mosaic Pretrained Transformer (MPT) family, highlighting its 7 billion parameter base model and various tuned versions, including one for chatting and another for storytelling. He shares an intriguing experiment where the model generated an epilogue for "The Great Gatsby," showcasing its creative potential. This conversation emphasizes the excitement around AI's capabilities and how it serves as a tool for unleashing human creativity.In this clip
From this podcast

The AI Podcast
MosaicML's Naveen Rao on Making Custom LLMs More Accessible - Ep. 199
Related Questions