Published Oct 11, 2022

SDS 617: Causal Modeling and Sequence Data — with Sean Taylor

Jon Krohn talks with Sean Taylor, Co-Founder and Chief Scientist of Motif Analytics, about causal modeling, large-scale experimentation at Lyft, and innovative approaches to sequence analytics. Taylor provides career advice for aspiring data scientists and discusses his transition from big tech to a startup environment.
Episode Highlights
Super Data Science: ML & AI Podcast with Jon Krohn logo

Popular Clips

Episode Highlights

  • Importance

    Causal modeling is essential for making informed decisions in data science. emphasizes the importance of designing experiments to create accurate causal estimates, rather than relying solely on pre-existing data 1. He believes that understanding causal methods benefits all data scientists, as it helps frame problems correctly and improves confidence in the results 2.

    It's probably going to benefit you either way, either in terms of building confidence and formalizing what you're already doing, or if it changes the answer, then surely you're going to do better by using a causal inference technique.

    ---

    This approach ensures that the conclusions drawn are more reliable and applicable to real-world scenarios.

       

    Methodologies

    Different methodologies in causal modeling offer various ways to approach data science problems. Sean discusses the value of design-based data science, where experiments are carefully planned to answer specific questions 1. He also highlights the importance of understanding the assumptions behind any model and the need for thorough diagnostics to ensure the model's validity 3.

    We attribute magical powers to them, as if their creators have somehow anticipated all the idiosyncrasies of your particular problem. It's unlikely that those creators have anticipated all those idiosyncrasies, and there's no substitute for evaluation.

    ---

    This comprehensive approach helps avoid common pitfalls and ensures that the chosen methodologies are appropriate for the specific context.

       

    Business Applications

    Causal modeling has significant applications in business, particularly in optimizing operations and making strategic decisions. Sean explains how causal inference helps companies like Lyft understand the impact of potential changes and choose the best course of action 4. He shares insights from his work at Lyft, where causal modeling was used to address complex issues such as pricing, dispatch, and driver incentives 5.

    The shortest path to having business impact on the business is to think about how do we estimate what would happen if we were to make certain changes and then choose the one that the estimate looks the best for.

    ---

    This approach allows businesses to make data-driven decisions that enhance efficiency and effectiveness.

Related Episodes