AI Model Innovations
The discussion highlights Databricks' new AI model featuring 132 billion parameters, which reportedly outperforms existing benchmarks. The model utilizes a mixture of experts architecture similar to GPT-4, employing 16 sub-models for enhanced efficiency. Notably, the development took two months and cost around $10 million, raising questions about industry competition and innovation strategies, especially in light of Apple's interest in Gemini for iPhone tasks.In this clip
From this podcast
AI Chat: ChatGPT & AI News, Artificial Intelligence, OpenAI, Machine Learning
Databricks Drops Open Source LLM DBRX, Beats Meta, xAI, Mixtral, GPT 3.5
Related Questions