NVIDIA H100 vs H200
NVIDIA lists the H100 SXM with 80GB of memory at 3.35TB/s, and the H200 SXM with 141GB at 4.8TB/s. Specs below are from NVIDIA's own spec sheets; rental prices are from each cloud's own price list. 8 of the GPU clouds tracked here price at least one of the two, and 6 price both.
Specifications
Each card's flagship server variant as NVIDIA names it, figures as NVIDIA prints them. H100: Figures from the Specifications table on NVIDIA's H100 product page. Figures marked * are with sparsity, as NVIDIA's footnote states. H200: Figures from the Specifications table on NVIDIA's H200 product page, which marks both columns as preliminary specifications that may be subject to change. Figures marked ² are with sparsity, as NVIDIA's footnote states.
| Spec | H100 SXM | H200 SXM |
|---|---|---|
| GPU memory | 80GB | 141GB |
| Memory bandwidth | 3.35TB/s | 4.8TB/s |
| FP8 Tensor Core | 3,958 teraFLOPS* | 3,958 TFLOPS² |
| INT8 Tensor Core | 3,958 TOPS* | 3,958 TFLOPS² |
| FP16 Tensor Core | 1,979 teraFLOPS* | 1,979 TFLOPS² |
| BF16 Tensor Core | 1,979 teraFLOPS* | 1,979 TFLOPS² |
| TF32 Tensor Core | 989 teraFLOPS* | 989 TFLOPS² |
| FP32 | 67 teraFLOPS | 67 TFLOPS |
| FP64 Tensor Core | 67 teraFLOPS | 67 TFLOPS |
| FP64 | 34 teraFLOPS | 34 TFLOPS |
| Max thermal design power (TDP) | Up to 700W (configurable) | Up to 700W (configurable) |
| Interconnect | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s |
| Form factor | SXM | SXM |
| Multi-Instance GPU (MIG) | Up to 7 MIGS @ 10GB each | Up to 7 MIGs @18GB each |
What renting each costs
Hourly on-demand prices from each cloud's own price list, alphabetical by cloud and not ranked: some price per GPU and others a whole multi-GPU node, and the unit is on every figure. Clouds that rent only one of the two show a dash for the other.
| Cloud | H100 | H200 |
|---|---|---|
| CoreWeave | NVIDIA HGX H100: $49.24 for 8 GPUs 27 Sept | NVIDIA HGX H200: $50.44 for 8 GPUs 27 Sept |
| Crusoe Cloud | NVIDIA H100 80GB HGX: $3.90 per GPU 27 Sept | NVIDIA H200 141GB HGX: $4.29 per GPU 27 Sept |
| Hyperstack | NVIDIA H100: $2.50 per GPU 27 SeptNVIDIA H100 NVLink: $2.60 per GPU 27 SeptNVIDIA H100 SXM: $3.20 per GPU 27 Sept | NVIDIA H200 SXM: $3.99 per GPU 27 Sept |
| Lambda | NVIDIA H100 PCIe: $3.29 per GPU 27 SeptNVIDIA H100 SXM: $4.29 per GPU 27 Sept | — |
| Nebius AI Cloud | NVIDIA HGX H100: $3.85 per GPU 27 Sept | NVIDIA HGX H200: $4.50 per GPU 27 Sept |
| Paperspace | H100: $5.95 per GPU 27 Sept | — |
| RunPod | H100 SXM: $3.49 per GPU 27 Sept | H200: $4.59 per GPU 27 Sept |
| Vast.ai | H100 PCIE: $1.64 per GPU 27 SeptH100 SXM: $1.73 per GPU 27 Sept | H200: $2.63 per GPU 27 Sept |