Causal inference

Topics covered
Popular Clips
Episode Highlights
Experimental Methods
Experimental methods in causal inference, such as A/B testing, are often seen as the "big hammer" for tech companies due to their straightforward application and ease of understanding. explains that while these methods are effective in controlled environments, they can be costly and sometimes unethical in complex scenarios like vaccine testing during the COVID-19 pandemic 1. He suggests that in cases where businesses can control variables, like a candle manufacturing business deciding on packaging, experimental approaches are beneficial 2.
Experiments are easy in many domains to set up, easy to understand, and you don't need a lot of background knowledge for it.
---
However, the challenge lies in determining the sample size and understanding the selection process to draw robust conclusions.
Observational Approaches
Observational approaches in causal inference are crucial when active experimentation isn't feasible. highlights that these methods involve passively observing data to deduce cause and effect, often facing challenges like self-selection bias 1. He notes that tools like causal random forests are developed to efficiently partition populations and reduce costs while maintaining robust conclusions 3.
We don't actively intervene ourselves, but we passively observe the data and still want to get cause and effect out of it.
---
These methods are particularly useful in scenarios where random assignment isn't possible, such as assessing the returns to college education.
Emerging Techniques
Emerging techniques in causal inference, like causal discovery and root cause analysis, are gaining traction in modern data science. shares that these methods are promising for extracting causality from observational data, though they require good benchmarking datasets 4. He also mentions the importance of integrating background knowledge into causal workflows, highlighting tools like Microsoft's DoWhy package that streamline the causal inference process 5.
How far can we go with just simply trying to get out causality from observational data?
---
These advancements are essential for addressing complex problems and enhancing the practical application of causal inference in various domains.
Related Episodes


Explainable AI that is accessible for all humans
Answers 383 questions

A casual conversation concerning causal inference
Answers 383 questions

Applied NLP solutions & AI education
Answers 383 questions

Generative models: exploration to deployment
Answers 383 questions

From ML to AI to Generative AI
Answers 383 questions

So you have an AI model, now what?
Answers 383 questions

Data science for intuitive user experiences
Answers 383 questions

Fighting bias in AI (and in hiring)
Answers 383 questions

AI's impact on developers
Answers 383 questions

Behavioral economics and AI-driven decision making
Answers 383 questions

Creating tested, reliable AI applications
Answers 383 questions

AI-driven studies of the ancient world and good GANs
Answers 383 questions

AI in healthcare, synthesizing dance moves, hardware acceleration
Answers 383 questions

AI code that facilitates good science
Answers 383 questions

Achieving provably beneficial, human-compatible AI
Answers 383 questions
