Published Jul 11, 2017

Video Object Detection at Scale with Reza Zadeh - #34

Reza Zadeh delves into the complexities of scaling deep learning for video object detection, highlighting the integration of open-source technology in Matroid's infrastructure and the pivotal role of hardware evolution from CPUs to TPUs, all while emphasizing user-friendly AI solutions and fault tolerance.
Episode Highlights
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) logo

Popular Clips

Episode Highlights

  • Open Source

    Reza Zadeh highlights the significant role of open-source innovations in Matroid's systems, emphasizing the importance of integrating these advancements quickly. He acknowledges that many of the compressed models used by Matroid originate from the open-source community, showcasing the power of collaboration and planning 1. Reza explains, "We don't think we can take on the open source community, it would be foolish," underscoring their strategy to embrace and contribute back to open source 2. This approach allows Matroid to enhance their models by incorporating external innovations efficiently.

       

    User-Friendly AI

    Matroid's approach to AI caters to non-developers, offering a user-friendly interface akin to "Photoshop for computer vision," where users can create detectors without programming skills 3. Reza Zadeh elaborates on their model integration strategies, combining pre-trained models with proprietary architectures to expand capabilities 2. He notes, "The ability to morph a model, to give it more capabilities by adding subnets to it, is something that is very valuable if done right," highlighting their focus on flexibility and innovation.

       

    Infrastructure

    The deployment of Kubernetes within Matroid's infrastructure enhances scalability and flexibility, despite challenges in setup, particularly on platforms like AWS 4. Reza Zadeh discusses the integration of TensorFlow with Kubernetes, noting that while TensorFlow supports distributed computing, it lacks fault tolerance compared to Spark 5. He mentions, "Kubernetes and TensorFlow do play very, very nicely with each other," emphasizing the synergy between these technologies for distributed machine learning tasks.

Related Episodes