Hardware Specs
GPU specifications relevant to RLVR cost modeling.
| GPU | VRAM | Mem BW | BF16 TFLOPS | FP4 PFLOPS | NVLink BW | Cloud $/hr |
|---|---|---|---|---|---|---|
| NVIDIA A100 80GB SXM | 80 GB | 2 TB/s | 312 | — | 600 GB/s | 1.75 |
| NVIDIA H100 80GB SXM | 80 GB | 3.35 TB/s | 990 | — | 900 GB/s | 2.69 |
| NVIDIA H200 141GB SXM | 141 GB | 4.8 TB/s | 990 | — | 900 GB/s | 3.5 |
| NVIDIA B200 192GB SXM | 192 GB | 8 TB/s | 4,500 | 20 | 1800 GB/s | 4.99 |
| NVIDIA B300 Ultra 288GB | 288 GB | 8 TB/s | 4,500 | 15 | — | — |
| NVIDIA Vera Rubin R200 | 288 GB | 22 TB/s | 12,000 | 50 | — | 8 |
Cloud Providers (H100 $/hr)
| Provider | Tier | H100 $/hr |
|---|---|---|
| thunder compute | budget | $1.38 |
| vast ai | budget | $1.87 |
| datacrunch | mid | $1.99 |
| runpod secure | mid | $2.69 |
| gcp | premium | $3 |
| lambda labs | premium | $3.44 |
| aws p5 | hyperscaler | $3.93 |
| azure | hyperscaler | $6.98 |