Data Persistence Strategies
Yingjun discusses the critical challenge of maintaining internal states in streaming databases, particularly the need for persistent storage to avoid data loss during machine crashes. He contrasts two approaches to horizontal scaling: one that requires data migration between machines and another that allows new machines to access remote object storage directly, eliminating downtime and consistency issues. This insight highlights the importance of choosing the right persistence strategy for efficient data processing.In this clip
From this podcast
Software Engineering Radio - the podcast for professional software developers
SE Radio 605: Yingjun Wu on Streaming Databases
Related Questions