Buffering data in memory before writing it to disk is crucial for durability, as highlighted by Alex. He explains the evolution from copy-on-write B-trees to two-component LSM trees, emphasizing the importance of merging data segments for efficient storage. The discussion reveals the inefficiencies of two-component designs and introduces the concept of multi-component LSM trees, which optimize space by compacting flushed tables and discarding outdated keys.