Published Sep 6, 2022

SDS 607: Inferring Causality — with Jennifer Hill

Jon Krohn and Jennifer Hill explore the art and science of inferring causality in data, delving into Bayesian statistics, hierarchical models, and innovative tools like Bayesian Additive Regression Trees to uncover deeper insights in data science.
Episode Highlights
Super Data Science: ML & AI Podcast with Jon Krohn logo

Popular Clips

Episode Highlights

  • Basic Concepts

    introduces the fundamental concepts of Bayesian statistics, contrasting them with frequentist approaches. She emphasizes the flexibility and honesty of Bayesian methods in expressing uncertainty and avoiding overfitting. adds that Bayesian statistics allow for more adaptable modeling strategies, which can be particularly useful in complex data scenarios 1. Hill also discusses the importance of prior specification in Bayesian models to prevent overfitting and improve model performance 2.

    In Bayesian statistics, we think parameters are unknown and uncertain, and we put a prior on them to express our uncertainty about them.

    ---

    Hill's pragmatic approach to Bayesian statistics highlights its practical advantages in real-world applications.

       

    BART Tool

    Hill delves into the advantages of Bayesian Additive Regression Trees (BART) for causal inference. She explains that BART, unlike other model fitters, provides coherent uncertainty estimates and avoids overfitting through clever prior specification 3. This makes BART particularly effective in scenarios where randomized control trials are not feasible. notes that BART's flexibility and Bayesian framework make it a powerful tool for causal inference 4.

    The nice thing for me is that it's embedded in a Bayesian framework, so you get a bunch of bonuses for that.

    ---

    Hill's insights into BART underscore its utility in making reliable causal inferences in complex data environments.

Related Episodes