Borg's scheduling mechanism revolves around tasks and containers, optimizing resource usage across machines while considering availability. By spreading tasks across multiple racks, Borg enhances system resiliency, protecting against potential failures like switch outages. The discussion highlights how collections of tasks, known as jobs, and alloc instances streamline operations in complex environments.