NVIDIA A100 vs H100
NVIDIA lists the A100 80GB SXM with 80GB HBM2e of memory at 2,039 GB/s, and the H100 SXM with 80GB at 3.35TB/s. Specs below are from NVIDIA's own spec sheets; rental prices are from each cloud's own price list. 8 of the GPU clouds tracked here price at least one of the two, and 7 price both.
Specifications
Each card's flagship server variant as NVIDIA names it, figures as NVIDIA prints them. A100: Figures from the Specifications table on NVIDIA's A100 product page, where a figure printed once across both columns is repeated in each. Figures marked * are with sparsity, as NVIDIA's footnote states. H100: Figures from the Specifications table on NVIDIA's H100 product page. Figures marked * are with sparsity, as NVIDIA's footnote states.
| Spec | A100 80GB SXM | H100 SXM |
|---|---|---|
| GPU memory | 80GB HBM2e | 80GB |
| Memory bandwidth | 2,039 GB/s | 3.35TB/s |
| FP8 Tensor Core | Not stated | 3,958 teraFLOPS* |
| INT8 Tensor Core | 624 TOPS | 1248 TOPS* | 3,958 TOPS* |
| FP16 Tensor Core | 312 TFLOPS | 624 TFLOPS* | 1,979 teraFLOPS* |
| BF16 Tensor Core | 312 TFLOPS | 624 TFLOPS* | 1,979 teraFLOPS* |
| TF32 Tensor Core | 156 TFLOPS | 312 TFLOPS* | 989 teraFLOPS* |
| FP32 | 19.5 TFLOPS | 67 teraFLOPS |
| FP64 Tensor Core | 19.5 TFLOPS | 67 teraFLOPS |
| FP64 | 9.7 TFLOPS | 34 teraFLOPS |
| Max thermal design power (TDP) | 400W*** | Up to 700W (configurable) |
| Interconnect | NVLink: 600 GB/s PCIe Gen4: 64 GB/s | NVIDIA NVLink™: 900GB/s PCIe Gen5: 128GB/s |
| Form factor | SXM | SXM |
| Multi-Instance GPU (MIG) | Up to 7 MIGs @ 10GB | Up to 7 MIGS @ 10GB each |
What renting each costs
Hourly on-demand prices from each cloud's own price list, alphabetical by cloud and not ranked: some price per GPU and others a whole multi-GPU node, and the unit is on every figure. Clouds that rent only one of the two show a dash for the other.
| Cloud | A100 | H100 |
|---|---|---|
| CoreWeave | NVIDIA A100: $21.60 for 8 GPUs 27 Sept | NVIDIA HGX H100: $49.24 for 8 GPUs 27 Sept |
| Crusoe Cloud | NVIDIA A100 80GB PCIe: $2.00 per GPU 27 SeptNVIDIA A100 80GB SXM: $2.30 per GPU 27 Sept | NVIDIA H100 80GB HGX: $3.90 per GPU 27 Sept |
| Hyperstack | NVIDIA A100: $1.35 per GPU 27 SeptNVIDIA A100 NVLink: $1.40 per GPU 27 SeptNVIDIA A100 SXM: $1.60 per GPU 27 Sept | NVIDIA H100: $2.50 per GPU 27 SeptNVIDIA H100 NVLink: $2.60 per GPU 27 SeptNVIDIA H100 SXM: $3.20 per GPU 27 Sept |
| Lambda | NVIDIA A100 SXM: $1.99 per GPU 27 SeptNVIDIA A100 PCIe: $1.99 per GPU 27 SeptNVIDIA A100 SXM: $2.79 per GPU 27 Sept | NVIDIA H100 PCIe: $3.29 per GPU 27 SeptNVIDIA H100 SXM: $4.29 per GPU 27 Sept |
| Nebius AI Cloud | — | NVIDIA HGX H100: $3.85 per GPU 27 Sept |
| Paperspace | A100: $3.09 per GPU 27 SeptA100-80G: $3.18 per GPU 27 Sept | H100: $5.95 per GPU 27 Sept |
| RunPod | A100 SXM: $1.59 per GPU 27 Sept | H100 SXM: $3.49 per GPU 27 Sept |
| Vast.ai | A100 SXM4: $0.37 per GPU 27 Sept | H100 PCIE: $1.64 per GPU 27 SeptH100 SXM: $1.73 per GPU 27 Sept |