Brendan emphasizes the importance of preparing physically for hunting trips by building endurance and managing calorie intake. He explains that during intense hikes, one can burn up to 2000 calories an hour, leading to a significant calorie deficit. This not only affects physical stamina but also mental sharpness, highlighting the need for resilience and toughness in the wilderness.