Ep 21: Modal CEO Erik Bernhardsson on Bringing Development to the Cloud, the GPU Market, and GenAI Music

GPU Market

The GPU market presents unique challenges, particularly in terms of access and pricing, which significantly impact businesses reliant on heavy computations. Erik Bernhardsson highlights the unusual dynamics where acquiring more GPUs can paradoxically increase costs, contrary to typical economic principles 1. This situation is compounded by the scarcity of high-performance GPUs like the A100s, leading companies to seek alternatives across various regions 2.

It's kind of the opposite in the cloud. Like if you want like a thousand GPUs, like the price actually goes up.

--- Erik Bernhardsson

Despite these challenges, Erik remains optimistic about the future, hoping for a normalization of GPU prices and increased capacity 2.

   

Compute Strategies

In navigating compute resources, Erik Bernhardsson envisions a future with greater GPU vendor diversity, which could lead to more affordable and scalable computing solutions 3. He expresses a desire for an automated GPU selection mechanism to simplify the deployment process for users, reducing the burden of choosing the right GPU for their needs 3.

I have a dream that I can wake up in a few years... where there's multiple GPU vendors.

--- Erik Bernhardsson

This vision aligns with the broader strategy of Modal, which aims to provide a seamless developer experience by offering end-to-end solutions that go beyond mere model hosting 4.