I'm not sure about others, but you can get A100s with 90gb of RAM from DigitalOcean for $1.15 an hour. So about 1/3 the price.

You can even get H100s for cheaper than these prices at $2.24 an hour.

So these do seem a bit expensive, but this might be because there is high demand for them from customers and they don't have the supply.

Just to correct the record, both $1.15 per A100 and $2.24 per H100 require a 3-year-commitment. On-demand prices are 2.5X that.

> $2.24/hour pricing is for a 3-year commitment. On-demand pricing for H100 is $5.95/hour under our special promo price.\$1.15/hour pricing is for a 3-year commitment.

Wow, that’s some spectacularly false advertising.

getting supply is super hard right now, DigitalOcean just straight up bought Paperspace to get access to those GPUs.

The whole reason Coreweave is on a fat growth trajectory right now is they used their VC money to buy a ton of GPUs at the right time

Company I work for had multiple times problems of not being able to allocate any gpus from some larger cloud providers (with the region restrictions we have, which still include all of EU as regions).

(I'm not sure which of them it was, we are currently evaluating multiple providers and I'm not really involved in that process.)