Merging Data Architectures
The conversation explores the limitations of the Lambda architecture and how the dataflow model emerged as a more efficient solution for combining batch and streaming processing. Frances highlights Google's evolution from Mapreduce and Mill Wheel to a unified system that allows teams to streamline their workflows and optimize latency requirements. The parallel development of these concepts within Google and the external community showcases a shared drive to innovate in big data processing.In this clip
From this podcast
Software Engineering Radio - the podcast for professional software developers
SE-Radio Episode 272: Frances Perry on Apache Beam
Related Questions