Cerebras GPT Unveiled
Cerebras has launched a series of open source models, Cerebras GPT, featuring permissive licenses that enable fine-tuning for proprietary tasks. With sizes ranging from 111 million to 13 billion parameters, these models adhere to chinchilla scaling laws, offering a pathway to achieve performance akin to ChatGPT. For those looking to efficiently train these models, exploring parameter efficient fine-tuning techniques is highly recommended.In this clip
From this podcast
Super Data Science: ML & AI Podcast with Jon Krohn
676: The Chinchilla Scaling Laws — with Jon Krohn (@JonKrohnLearns)
Related Questions