Grand Ideas, Spectral Networks
David delves into the evolution of machine learning models, highlighting the shift towards higher dimensions and complex representations. He shares his passion for pushing boundaries with new learning paradigms, like leveraging curvature for meaningful learning signals. Daniel explores surprising insights on optimization problems, shedding light on the convergence of algorithms in non-convex scenarios.In this clip
From this podcast

The Gradient
David Pfau: Manifold Factorization and AI for Science
Related Questions
What is the significance of transformers in neural network architectures, as discussed in the episode Ilya Sutskever: Deep Learning | Lex Fridman Podcast #94 and the clip Introduction to GPT-2?
What's your opinion on using large language models (LLMs) for scientific research, especially for generating new ideas for hypotheses as discussed in the episode "Neurosymbolic AI in Search with Professor Laura Dietz - Weaviate Podcast #49!" and the clip "Knowledge Graph Queries"?