Joe and Allen discuss the importance of checking return values in coding. They emphasize the significance of always verifying return values to prevent errors and ensure code reliability. The conversation touches on the necessity of explicitly handling return values, even in shell scripts, to avoid overlooking critical information.