Alexander discusses the challenges of learning causal structure solely from observational data, highlighting the need for interactions with the world to make certain connections. He emphasizes the importance of practicality in causal observations, citing examples like dietary studies where certain scenarios are not feasible to test but must be accounted for in the learning process.