Kyle discusses how entrepreneurs should not let probabilities deter them from taking action, using examples from Peter Thiel and Ben Horowitz. He highlights how Edward Thorpe utilized probabilities to beat the casino despite uncertain chances of success, emphasizing the importance of agency over statistics.