Diogo discusses the limitations of current software tools in machine learning, emphasizing the need for better benchmarks and flexibility. He highlights the struggle of translating complex ideas into code, pointing out that while frameworks like TensorFlow have advanced the field, they can also hinder the implementation of innovative techniques. The conversation reveals a tension between high-level abstractions and the necessity for lower-level customization in deep learning research.
