SDS 522: Data Tools vs. Data Platforms — with Jon Krohn

Platform Basics

Jon Krohn provides a clear distinction between data tools and data platforms. He explains that while programming languages like Python are standalone, data platforms such as Spark, Kafka, and Hadoop are frameworks that support the development of multiple data tools within them 1. Jon emphasizes that these platforms are not standalone languages but can host various tools, enhancing their versatility 2.

Neither data tools nor data platforms are standalone programming languages. Nevertheless, data platforms can support the development of multiple data tools within them.

--- Jon Krohn

This distinction is crucial for understanding how these platforms operate and their role in the data science ecosystem.

   

Platform Examples

Jon delves into specific examples of data platforms, highlighting Spark, Kafka, and Hadoop as prominent players in handling massive data quantities. Spark, for instance, supports tools like Spark NLP and SparkML Lib, showcasing its capability to integrate various data tools 2. These platforms are essential for managing and processing large datasets efficiently, making them invaluable in the data science field.

For example, Spark is a platform for working with massive quantities of data that itself supports particular data tools, such as Spark NLP and SparkML Lib within it.

--- Jon Krohn

Understanding these platforms' functionalities helps in leveraging their full potential for data-driven projects.