Inference Innovations
Jeff highlights a fascinating area of innovation in the realm of inference. He discusses the typical pipeline for model training and deployment, emphasizing the need for effective quantization and optimization. The conversation delves into how models are interpreted by various runtimes, whether they are open formats like TensorFlow Lite or proprietary solutions, and the importance of hardware acceleration in this process.In this clip
From this podcast
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Spiking Neural Nets and ML as a Systems Challenge with Jeff Gehlhaar - TWIML Talk #280
Related Questions
How is inference used in ML?
How is inference used in machine learning, as discussed in the episode Dileep George: Brain-Inspired AI | Lex Fridman Podcast #115 and the clip Graphical Models Explained?
How is inference used in machine learning, as discussed in the episode Dileep George: Brain-Inspired AI | Lex Fridman Podcast #115 and the clip Graphical Models Explained?