Software Engineering Radio - the podcast for professional software developers avatar

Dexa/Software Engineering Radio - the podcast for professional software developers

Learn more
Published Sep 3, 2019

SE-Radio Episode 315: Jeroen Janssens on Tools for Data Science

Dive into the dynamic world of data science with Jeroen Janssens as he and Felienne Hermans discuss the transformative power of open source, the nuances of educational pathways, the pros and cons of Python and R, and the importance of machine learning in data-driven insights.
Episode Highlights
Software Engineering Radio - the podcast for professional software developers logo

Topics covered

Popular Clips

Episode Highlights

  • Languages

    The choice between R and Python in data science often depends on the specific needs of a project. explains that R, designed by statisticians, excels in statistical and machine learning tasks, offering features like non-standard evaluation that simplify data manipulation 1. However, Python's broader scope makes it suitable for a wider range of applications, from API development to game creation 2. summarizes, "R is closer to the world of a statistician and makes some things easier. However, it's not a full programming language there. Python might be more suitable if you want to do a broader range of things."

    R is closer to the world of a statistician and makes some things easier. However, it's not a full programming language there. Python might be more suitable if you want to do a broader range of things.

    ---

    Ultimately, the decision often hinges on team preferences and project requirements, with Python frequently favored for production environments 2.

       

    Command Line

    Command line tools offer significant advantages for data manipulation and analysis, particularly in the early stages of a data science project. highlights the flexibility of command line tools, which can often accomplish tasks in fewer lines than traditional programming languages 3. Tools like curl, JQ, and GNU parallel exemplify the power of the command line in handling data efficiently 3. notes, "What you're arguing, I think, is not do all your stuff on the command line, but more be aware that there are these awesome tools on the command line that can help you do things more efficiently but don't use them forever."

    What you're arguing, I think, is not do all your stuff on the command line, but more be aware that there are these awesome tools on the command line that can help you do things more efficiently but don't use them forever.

    ---

    While command line tools are invaluable for quick data exploration, transitioning to a programming language is often necessary for building robust, reproducible solutions 4.

Related Episodes