Pat explains the concept of idempotence, emphasizing its significance in computing and distributed systems. By illustrating with examples like sweeping floors and baking cakes, he highlights how certain operations can be repeated without changing the outcome. This understanding is crucial for building resilient systems that can handle retries effectively, ensuring consistent results even when requests are duplicated.