How Much Does an H100 Cost?

There is no single H100 price, and any figure quoted without context is misleading.

There are three different numbers people conflate. The purchase price of a server containing several accelerators, which is negotiated and includes networking, memory and integration. The hourly rental rate, which varies widely between providers and falls sharply with commitment length. And the effective cost of the work you actually complete, which depends on utilisation and how efficiently your code uses the hardware.

The useful metric is cost per training run or cost per million tokens served. A cheaper hourly rate on a poorly networked cluster is frequently more expensive per finished job.

Our GPU price tracker collects provider rates so they can be compared in one place.