Atomicity in Processing
The discussion delves into the concept of atomicity within distributed stream processing systems, emphasizing that jobs are not necessarily atomic due to their long-running nature. Yi explains how consistency and failure recovery are prioritized over atomicity, utilizing a replayable ADEM policy to manage state across multiple processes. This approach allows for greater throughput while handling vast amounts of incoming data, challenging traditional notions of atomic operations.In this clip
From this podcast
Software Engineering Radio - the podcast for professional software developers
Episode 436: Apache Samza with Yi Pan
Related Questions