Andrew Feldman: Cerebras and AI Hardware

Topics covered
Popular Clips
Episode Highlights
Pharma Revolution
AI accelerators are transforming pharmaceutical research by enabling rapid data analysis and experimentation. highlights the collaboration with GlaxoSmithKline (GSK), where Cerebras Systems utilized a version of BERT called Ebert to analyze genetic sequences, significantly speeding up the research process 1. This advancement allows scientists to explore questions previously deemed too time-consuming, as Feldman notes, "Taking 25 days on a 16 node cluster is too long to ask many interesting questions."
What Galaxy showed was that our system was for work they used to do on a 16 node GPU cluster in 20 days we did in about two days.
---
The ability to process large datasets quickly opens new avenues in life sciences, potentially revolutionizing how pharmaceutical companies approach drug discovery and development 1.
Industry Impact
The impact of AI accelerators extends beyond pharmaceuticals, influencing various industries through rapid iterations and advancements. discusses the challenges faced by Cerebras Systems in competing with established players like Nvidia and AMD, emphasizing the importance of patient customers who believe in their vision 2. He explains, "You need to find some customers who have vision and who want to bet on your trajectory, not just on where you are today."
Many of the guys who'd been with us at C Seamicro, we started meeting, and as computer architects do, we say, is there a new workload? Could we build a better machine for it?
---
Feldman also highlights the serendipitous role of GPUs in AI development, noting that their architecture, initially designed for graphics, inadvertently suited AI workloads 3. This realization led to the creation of a new machine, capable of handling complex AI tasks more efficiently, thus paving the way for further innovation across scientific fields 3.
Related Episodes


Jeremy Howard on Kaggle, Enlitic, and fast.ai
Answers 383 questions

Daniel Situnayake: AI on the Edge
Answers 383 questions

Kyunghyun Cho: Neural Machine Translation, Language, and Doing Good Science
Answers 383 questions

Sara Hooker: Cohere For AI, the Hardware Lottery, and DL Tradeoffs
Answers 383 questions

David Pfau: Manifold Factorization and AI for Science
Answers 383 questions

Kate Park: Data Engines for Vision and Language
Answers 383 questions

Luis Voloch: AI and Biology
Answers 383 questions

Chip Huyen: Machine Learning Tools and Systems
Answers 383 questions

David Chalmers on AI and Consciousness
Answers 383 questions

Sergey Levine on Robot Learning & Offline RL
Answers 383 questions

Kathleen Fisher: DARPA and AI for National Security
Answers 383 questions

Yann LeCun on his Start in Research and Self-Supervised Learning
Answers 383 questions

Scott Aaronson: Against AI Doomerism
Answers 383 questions

Joel Simon on AI art and Artbreeder
Answers 383 questions
