Hey, we have this data privately at Shadeform. Happy to discuss details and potentially sharing.

Feel free to email at ed at shadeform dot ai

We have 15+ clouds you can try on our platform if you're looking for a place to compare inference engines

Email me at ed at shadeform dot ai if we can help

This is a trend we noticed early last year, so we started building a single console for all these clouds at https://shadeform.ai.

It has been amazing to watch this industry explode, and we believe it is great for consumers. The same instances on Amazon versus these alternative providers are 3x more expensive.

NVIDIA and many hardware providers are leaning into this trend. As clouds become more and more vertically integrated, AMD, NVIDIA, and others will benefit from spreading their hardware to more clouds.

Knowing that these models will not be running in 3 easily controlled clouds may also benefit us in the long run as each provider will have different levels of comfort with models of varying capabilities.

How does Shadeform make money?

If you’re looking for a new GPU cloud because of this, we’ve put all these providers in on place, console, and API so you can find a new one for your needs at https://shadeform.ai

* I’m one of the founders

Hey, you can use https://shadeform.ai to provision infrastructure in any GPU cloud or marketplace.

I can send you the details for how to view your current balance from our API. Feel free to email me at ed@shadeform.ai

(I am one of the founders)

This looks interesting, you offer like a single endpoint to all those CloudGPU providers, right? Will definitely check this out, thanks!

If you want to check them all out in one place, we built a platform for that at https://shadeform.ai

if you're interested in exploring providers shadeform will let you compare prices for the same cards across providers*

i'm one of the founders

What company is this? Curious if you'd be open to talking about how you manage compute across providers.

I'm not GP but have been in this boat. We tried a number of different approaches, and kubernetes was by far the most successful. Terraform to provision the k8s clusters, workloads deployed to k8s. With OpenShift it gets even better, though I left the project before we finished implementation so I can't say how it went in prod. Early tests were very good though. If you're feeling bold you can do a "stretch" cluster which has nodes in different data centers (some on-prem for example, some in the cloud, or all in the cloud but different zones). The latency between the masters and nodes can cause problems though so I wouldn't separate them geographically very far.

We have aggregated most cloud GPU providers into a single platform, so you have an easier time getting the machines you need with our aggregated availability. You can check live availability and prices at https://shadeform.ai

Disclaimer - I am one of the cofounders.

You can run models at https://shadeform.ai in your cloud accounts or ours, and we don’t track or keep anything.