Alan and Joe discuss the importance of setting up readmes in directories to establish code guidelines, prevent misplaced code, and streamline the review process, especially in a mono repo setting. By providing clear instructions, developers can save time and avoid unnecessary frustration.