Advancing Sparse Matrices
Sayak highlights the need for improved tooling around sparsity in machine learning frameworks. Yannic discusses the potential of block sparsity techniques and the challenges in allocating resources for developing new hardware directions. Sara reflects on the complexity of exploring different hardware paths amidst uncertain hypotheses and high costs.In this clip
From this podcast
Machine Learning Street Talk (MLST)
Sara Hooker - The Hardware Lottery, Sparsity and Fairness
Related Questions
How does hardware production impact artificial intelligence in the episode Sara Hooker - The Hardware Lottery, Sparsity and Fairness and the clip Hardware Lottery Insights?
How does hardware evolution impact software innovation according to Seth Godin in the episode Sara Hooker - The Hardware Lottery, Sparsity and Fairness and the clip Hardware Lottery Insights?
Is it true that when the cost of trying new technologies goes to zero, deciding what to build becomes the bottleneck, and that knowing which model output is merely plausible and which is actually good is not a commodity skill, making taste in technology a defining advantage, as discussed in the episode LLMs to agents: The Beauty & Perils of Investing in GenAI // VC Panel // Agents in Production and the clip Enterprise Innovation Challenges?