Liyuan discusses advancements in MoE techniques, including the development of spasmic trophy models and the challenge of sampling multiple experts. He invites collaboration and questions from listeners interested in MOE training. The conversation also touches on Nvidia's NVLM release, raising questions about its performance compared to other leading models in multimodal tasks.
