Joe and Alan discuss the drawbacks of scattering compiler directives throughout code, emphasizing the importance of centralized control for better code readability and maintainability. They highlight the significance of clean architecture principles in managing dependencies effectively.