Efficient Sparse Mix
Arthur introduces Mixtrol, a sparse mixture of experts model with 46 billion parameters but executes only 12 billion per token, enhancing efficiency in both training and inference times.In this clip
From this podcast
AI + a16z
ARCHIVE: Open Models (with Arthur Mensch) and Video Models (with Stefano Ermon)
Related Questions