GPU Developments 2020

The latest GPUs have seen a significant increase in memory, with the 3090 boasting 24 gigs compared to the previous 1080 Ti's 11 gigs. This enhancement allows for training larger models, a crucial factor for data scientists. While speed improvements have been modest, the commercial value of high-memory GPUs justifies their steep prices, with advanced options like Nvidia's DGX workstation providing a staggering 320 gigs of memory.