Training Massive Language Models

Stella shares how they defied conventional wisdom by training billion-parameter language models independently, sparking excitement and interest in the AI community. Leveraging resources and partnerships, they pushed boundaries to create some of the largest publicly available models at the time.