Randy discusses the challenges of horizontally splitting the data tier while introducing functional segmentation as a simpler approach. By categorizing databases into user, item, and transactional segments, he highlights the importance of using familiar data modeling techniques at a higher level. This method allows for a complex infrastructure, featuring 1,000 logical databases spread across 400 physical hosts, showcasing an effective mapping strategy.