Erez explains how RDMA enables direct data transmission from user space, drastically reducing latency compared to traditional TCP and UDP methods. He highlights the efficiency of RDMA in high-performance networking, particularly with Infiniband and Ethernet, where network adapters handle transport in hardware without CPU involvement. The conversation also touches on GPU Direct, emphasizing its role in facilitating efficient memory access for GPUs through RDMA technology.