Chris emphasizes the significance of strong data pipelines in machine learning, highlighting it as an underrated aspect. He discusses how focusing on building robust data infrastructure is crucial for successful ML systems, beyond just the flashy model training aspects.