server

NVIDIA DGX H200

The same trusted DGX chassis, upgraded to H200 memory

$349,000

Estimated from per-GPU H200 broker pricing; NVIDIA does not publish DGX list prices.

Specs

  • GPUs in this unit8
  • Total GPU memory1,128 GB
  • Memory bandwidth (per GPU)4,800 GB/s
  • Total power draw10,200 W
  • Compute (dense BF16/FP16)7,912 TFLOPS

8x H200 SXM5, dual host CPUs, NVSwitch fabric, single rack-mount chassis.

What this actually means for you

Same 8-GPU server design as the DGX H100, with H200 GPUs instead — about 1.1 terabytes of combined memory in one box. This is the workhorse behind most of the startup-tier builds we recommend below.

Solo capacity: at the standard FP16/BF16 rule of thumb (2 GB of GPU memory per billion parameters, plus 20% overhead for context), this unit's 1,128 GB can hold an open-source model up to roughly 470 billion parameters before you'd need more hardware.

Power & running cost

Continuous draw
10.20 kW
Monthly electricity
$1,381
Everyday comparison
~8.4 homes

Run 24/7, this unit uses 244.8 kWh/day — about the same continuous power draw as 8.4x an average U.S. home (~29 kWh/day, EIA). Monthly cost assumes the 2026 U.S. residential average of 18.8¢/kWh.

Request this build

No payment, no account — just tell us your name and we'll follow up with a real quote.