Mid-size company build

Running Gemma 4 31B

Google · Apache 2.0 · 31B parameters

The memory math: 31B parameters × 2 GB/B = 61 GB baseline, + 20% overhead for KV cache/context = 74 GB minimum required.
Recommended build

1x NVIDIA H200 SXM

A single datacenter-grade GPU instead of a workstation card: ECC memory, a server chassis built for 24/7 operation, and roughly double the memory headroom — worth the upgrade once you have real concurrent traffic and reliability expectations to meet.

Combined GPU memory
141 GB
Total price
$35,000
Combined power draw
0.7 kW
Monthly electricity
$95

1 × NVIDIA H200 SXM at 700 W each = 700 W total. Run 24/7, that's 16.8 kWh/day — about the same continuous draw as 0.6 average U.S. homes (~29 kWh/day/home, EIA). Monthly cost assumes 18.8¢/kWh, the 2026 U.S. residential average.

See full specs for NVIDIA H200 SXM →

Request this build

No payment, no account — just tell us your name and we'll follow up with a real quote.

Building for a small startup instead? See the startup build for Gemma 4 31B →