Joshua discusses the challenges of dynamic tasking in build systems like SBT and Gradle, emphasizing the need for innovative solutions. He highlights the distinction between build systems suited for large codebases and those optimized for microservices, advocating for a hybrid approach that balances team-specific productivity with overarching conventions. This perspective encourages teams to create tailored builds while maintaining consistency in higher-level operations.