NVIDIA B200 vs H100
Specs below are from NVIDIA's own spec sheets; rental prices are from each cloud's own price list. 8 of the GPU clouds tracked here price at least one of the two, and 6 price both.
Specifications
Each card's flagship server variant as NVIDIA names it, figures as NVIDIA prints them. B200: Per-system figures for an eight-GPU NVIDIA HGX B200 board, from the specifications table on NVIDIA's HGX platform page, which prints no per-GPU figures except NVLink GPU-to-GPU bandwidth; where NVIDIA prints one figure for two precisions (FP8/FP6, FP16/BF16, FP64/FP64 Tensor Core) it is recorded under each. Figures marked ¹ are shown sparse | dense and figures marked ² are sparse, with dense half the figure shown, as NVIDIA's footnotes state. H100: Figures from the Specifications table on NVIDIA's H100 product page. Figures marked * are with sparsity, as NVIDIA's footnote states.
Not like for like: NVIDIA publishes B200 figures only for the whole HGX B200 (8 GPUs) board, and H100 figures only per GPU. The HGX B200 (8 GPUs) column is the whole board; this page does not divide it into a per-GPU figure NVIDIA does not print. The rental prices further down are per GPU or per node as each cloud states, and are the like-for-like comparison here.
| Spec | HGX B200 (8 GPUs) | H100 SXM |
|---|---|---|
| GPU memory | 1.4 TB | 80GB |
| Memory bandwidth | Not stated | 3.35TB/s |
| FP4 Tensor Core | 144 PFLOPS | 72 PFLOPS¹ | Not stated |
| FP6 Tensor Core | 72 PFLOPS² | Not stated |
| FP8 Tensor Core | 72 PFLOPS² | 3,958 teraFLOPS* |
| INT8 Tensor Core | 72 POPS² | 3,958 TOPS* |
| FP16 Tensor Core | 36 PFLOPS² | 1,979 teraFLOPS* |
| BF16 Tensor Core | 36 PFLOPS² | 1,979 teraFLOPS* |
| TF32 Tensor Core | 18 PFLOPS² | 989 teraFLOPS* |
| FP32 | 600 TFLOPS | 67 teraFLOPS |
| FP64 Tensor Core | 296 TFLOPS | 67 teraFLOPS |
| FP64 | 296 TFLOPS | 34 teraFLOPS |
| Max thermal design power (TDP) | Not stated | Up to 700W (configurable) |
| Interconnect | NVIDIA NVLink Fifth generation; NVLink GPU-to-GPU Bandwidth 1.8 TB/s; Total NVLink Bandwidth 14.4 TB/s | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s |
| Form factor | 8x NVIDIA Blackwell SXM | SXM |
| Multi-Instance GPU (MIG) | Not stated | Up to 7 MIGS @ 10GB each |
What renting each costs
Hourly on-demand prices from each cloud's own price list, alphabetical by cloud and not ranked: some price per GPU and others a whole multi-GPU node, and the unit is on every figure. Clouds that rent only one of the two show a dash for the other.
| Cloud | B200 | H100 |
|---|---|---|
| CoreWeave | NVIDIA HGX B200: $68.80 for 8 GPUs 27 Sept | NVIDIA HGX H100: $49.24 for 8 GPUs 27 Sept |
| Crusoe Cloud | — | NVIDIA H100 80GB HGX: $3.90 per GPU 27 Sept |
| Hyperstack | NVIDIA B200: $6.00 per GPU 27 Sept | NVIDIA H100: $2.50 per GPU 27 SeptNVIDIA H100 NVLink: $2.60 per GPU 27 SeptNVIDIA H100 SXM: $3.20 per GPU 27 Sept |
| Lambda | NVIDIA B200 SXM6: $6.99 per GPU 27 Sept | NVIDIA H100 PCIe: $3.29 per GPU 27 SeptNVIDIA H100 SXM: $4.29 per GPU 27 Sept |
| Nebius AI Cloud | NVIDIA HGX B200: $7.15 per GPU 27 Sept | NVIDIA HGX H100: $3.85 per GPU 27 Sept |
| Paperspace | — | H100: $5.95 per GPU 27 Sept |
| RunPod | B200: $6.79 per GPU 27 Sept | H100 SXM: $3.49 per GPU 27 Sept |
| Vast.ai | B200: $6.25 per GPU 27 Sept | H100 PCIE: $1.64 per GPU 27 SeptH100 SXM: $1.73 per GPU 27 Sept |