Published Dec 3, 2019

Team Data Science Process

Join Kyle Polich and Buck Woody as they delve into the Team Data Science Process, showcasing how structured workflows elevate collaboration and efficiency within organizations. They further explore the pivotal role of technologies like Docker and Kubernetes in data science, while addressing the importance of data accuracy, infrastructure reliability, and ethical AI integration.
Episode Highlights
Data Skeptic logo

Popular Clips

Episode Highlights

  • Docker & Kubernetes

    Docker and Kubernetes revolutionize data science by enhancing scalability and efficiency. explains how Docker creates isolated environments, allowing for thousands of instances to run simultaneously without reloading identical code 1. Kubernetes, originally developed by Google, orchestrates these environments, ensuring seamless operation across nodes and handling failures automatically 2.

    Kubernetes abstracts hardware storage into persistent volumes, allowing for dynamic resource allocation and management.

    ---

    This orchestration enables data scientists to focus on their models, knowing the infrastructure is robust and scalable.

       

    AI Integration

    AI's integration into everyday technology is becoming seamless and ubiquitous. predicts that AI will become so embedded in our tools that it will no longer be a distinct feature, much like how computers are now a given in businesses 3. He emphasizes the importance of understanding AI's ethical implications, urging data scientists to be cautious with the trust placed in AI systems 4.

    AI is just going to bake into everything, becoming ubiquitous.

    ---

    This shift will require transparency and responsibility in AI development and deployment.

Related Episodes