Published Dec 3, 2019

Team Data Science Process

Join Kyle Polich and Buck Woody as they delve into the Team Data Science Process, showcasing how structured workflows elevate collaboration and efficiency within organizations. They further explore the pivotal role of technologies like Docker and Kubernetes in data science, while addressing the importance of data accuracy, infrastructure reliability, and ethical AI integration.
Episode Highlights
Data Skeptic logo

Popular Clips

Episode Highlights

  • Data Accuracy

    Ensuring data accuracy is crucial for reliable predictive modeling, as explains through his experiences with predictive maintenance. He emphasizes the importance of thoroughly examining data sources and understanding their origins to avoid errors in predictions. For instance, in a project involving air conditioning units, he discovered discrepancies in temperature data due to differences in sensor reporting intervals, which led to inaccurate predictions 1 2.

    It takes a domain expert in the predictions, not the machines, and it takes an expert in the machines and not the prediction to get the prediction, right.

    ---

    This highlights the need for collaboration between domain experts and data scientists to ensure data integrity and accuracy 3.

       

    Infrastructure

    Reliable infrastructure is essential for successful data science projects, as discusses the role of virtualization and containerization in efficient deployment. He explains how technologies like Docker enable the creation of lightweight, scalable environments that streamline the deployment process 4. This approach allows for efficient resource utilization and simplifies the management of complex systems.

    You set up a text file, of course, everything's a YAML file these days, right? Everything's yet another markup language file.

    ---

    Additionally, Woody advises young professionals to focus on computational basics, mathematics, and learning how to learn, as these skills are fundamental to adapting to the rapidly changing technological landscape 5.

Related Episodes