Published Jul 7, 2014

The Right (big data) Tool for the Job with Jay Shankar

Jay Shankar joins Kyle Polich to explore the evolving landscape of big data tools, emphasizing a shift towards high-level solutions and pragmatic tool selection to meet business needs. Shankar also delves into data engineering philosophies, advocating for a deep understanding of data, adaptability, and the strategic use of cloud-based systems.

Episode Highlights

Topics covered

Episode Highlights

Related Episodes

Big Data Tools and Trends
Answers 383 questions
Big Data Doesn't Exist
Answers 383 questions
LLMs for Data Analysis
Answers 383 questions
Data in Healthcare IT with Shahid Shah
Answers 383 questions
Data science tools and other announcements from Ignite
Answers 383 questions
Team Data Science Process
Answers 383 questions
Data Science at eHarmony
Answers 383 questions
Data Science Hiring Processes
Answers 383 questions
Machine Learning Done Wrong
Answers 383 questions
Data Infrastructure in the Cloud
Answers 383 questions
[MINI] MapReduce
Answers 383 questions
Dev Ops for Data Science
Answers 383 questions
Jumpstart Your ML Project
Answers 383 questions
AI Roundtable
Answers 383 questions
Applied Data Science in Industry
Answers 383 questions

Dexa/Kyle Polich

The Right (big data) Tool for the Job with Jay Shankar

Topics covered

Popular Clips

Open Source Advantage

Evolving Data Ecosystem

Normalizing Feed Files

Leveraging the Cloud

Picking Data Tools

Understanding MapReduce

Navigating Changing Data Landscapes

MapReduce and Independent Films

Data Challenges

Big Data Challenges

Navigating Data Tools

Exploring MapReduce

Real-Time Data Trends

Syndication and Catalog Optimization

Episode Highlights

Trends and Predictions

Design Philosophy

Big Data Solutions

Related Episodes

Big Data Tools and Trends

Big Data Doesn't Exist

LLMs for Data Analysis

Data in Healthcare IT with Shahid Shah

Data science tools and other announcements from Ignite

Team Data Science Process

Data Science at eHarmony

Data Science Hiring Processes

Machine Learning Done Wrong

Data Infrastructure in the Cloud

[MINI] MapReduce

Dev Ops for Data Science

Jumpstart Your ML Project

AI Roundtable

Applied Data Science in Industry

The Right (big data) Tool for the Job with Jay Shankar

Topics covered

Popular Clips

Episode Highlights

Trends and PredictionsJay Shankar explores the future of big data tools and industry trends, emphasizing the shift towards higher-level solutions and the importance of understanding data. He highlights the need for a pragmatic approach in selecting tools that align with business needs.

Trends and Predictions

Design PhilosophyJay Shankar shares insights on the philosophical approaches and system scalability in data engineering. He highlights the importance of understanding data, adapting to changes, and leveraging cloud solutions for efficient data management.

Design Philosophy

Big Data SolutionsJay Shankar, a big data engineer, shares insights on selecting the right tools and strategies for managing big data effectively. He discusses the importance of tool choice, real-time processing, and overcoming data challenges in today's competitive environment.

Big Data Solutions

Related Episodes