Iordanis discusses the challenges of developing quantum neural networks, highlighting the limitations of current qubit availability and the difficulties in simulating these networks on classical computers. He draws parallels to the early days of classical machine learning, emphasizing the need for innovative architectures and the struggle to validate their effectiveness without extensive experimental data. The conversation reveals the intricate balance between error rates and computational time in quantum algorithms, shedding light on the future potential of quantum neural networks.