Joe and Michael discuss the importance of considering artifacts as immutable in the build pipeline process, emphasizing the need to prevent unauthorized modifications. They highlight the significance of maintaining version control and access restrictions to ensure the integrity of the artifacts.