SDS 607: Inferring Causality — with Jennifer Hill

Topics covered
Popular Clips
Episode Highlights
Basic Concepts
introduces the fundamental concepts of Bayesian statistics, contrasting them with frequentist approaches. She emphasizes the flexibility and honesty of Bayesian methods in expressing uncertainty and avoiding overfitting. adds that Bayesian statistics allow for more adaptable modeling strategies, which can be particularly useful in complex data scenarios 1. Hill also discusses the importance of prior specification in Bayesian models to prevent overfitting and improve model performance 2.
In Bayesian statistics, we think parameters are unknown and uncertain, and we put a prior on them to express our uncertainty about them.
---
Hill's pragmatic approach to Bayesian statistics highlights its practical advantages in real-world applications.
BART Tool
Hill delves into the advantages of Bayesian Additive Regression Trees (BART) for causal inference. She explains that BART, unlike other model fitters, provides coherent uncertainty estimates and avoids overfitting through clever prior specification 3. This makes BART particularly effective in scenarios where randomized control trials are not feasible. notes that BART's flexibility and Bayesian framework make it a powerful tool for causal inference 4.
The nice thing for me is that it's embedded in a Bayesian framework, so you get a bunch of bonuses for that.
---
Hill's insights into BART underscore its utility in making reliable causal inferences in complex data environments.
Related Episodes


SDS 617: Causal Modeling and Sequence Data — with Sean Taylor
Answers 383 questions

SDS 613: Causal Machine Learning — with Emre Kiciman
Answers 383 questions
SDS 506: Supervised vs Unsupervised Learning — with Jon Krohn
Answers 383 questions

SDS 507: Bayesian Statistics — with Rob Trangucci
Answers 383 questions

SDS 539: Interpretable Machine Learning — with Serg Masís
Answers 383 questions

SDS 595: Data Engineering 101 — with Joe Reis and Matt Housley
Answers 383 questions

SDS 587: Data Engineering for Data Scientists — with Mark Freeman
Answers 383 questions

SDS 479: Knowledge Graphs — with Maureen Teyssier
Answers 383 questions

SDS 487: Fixing Dirty Data — with Susan Walsh
Answers 383 questions
SDS 558: @JonKrohnLearns's Answers to Questions on Machine Learning
Answers 383 questions
SDS 504: Classification vs Regression — with Jon Krohn
Answers 383 questions

SDS 435: Scaling Up Machine Learning — with Erica Greene
Answers 383 questions

838: Consciousness and Machines — with Jennifer K. Hill
Answers 383 questions

SDS 437: Data Science at a World-Leading Hedge Fund — with Claudia Perlich
Answers 383 questions













