NVIDIA · Data centre

A100

Rented by 3 providers. 6 exact variants are priced separately, because they are different silicon.

Best published rate

$1.00

per GPU / hour
RunPod · SXM · 40 GB

Every published rate

cheapest first · USD per GPU per hour

Provider	What they call it	Their own price, and the arithmetic	Per GPU-hour
RunPod SXM · 40 GB	A100 SXM 40GB NVIDIA A100-SXM4-40GB	$1.00 per hour = $1.0000 per GPU-hour region Community Cloud · 1 offer Low stock	$1.0000 $3.21 per PFLOP-hr
RunPod PCIe · 80 GB	A100 PCIe NVIDIA A100 80GB PCIe	$1.19 per hour = $1.1900 per GPU-hour region Secure Cloud · 1 offer Low stock	$1.1900 $3.81 per PFLOP-hr
RunPod SXM · 80 GB	A100 SXM NVIDIA A100-SXM4-80GB	$1.39 per hour = $1.3900 per GPU-hour region Secure Cloud · 1 offer Medium stock	$1.3900 $4.46 per PFLOP-hr
Vultr 80 GB	A100 vbm-48c-1024gb-4-a100-gpu	$9.59 per hour ÷ 4 GPUs = $2.3973 per GPU-hour regions not published in this feed · 1 offer	$2.3973 $7.68 per PFLOP-hr
Vultr SXM · 80 GB	A100 vbm-112c-2048gb-8-a100-gpu	$22.40 per hour ÷ 8 GPUs = $2.8000 per GPU-hour region fra · 1 offer	$2.8000 $4.46 per PFLOP-hr
Azure 40 GB	A100 Standard_ND96asr_v4	$27.20 per hour ÷ 8 GPUs = $3.3996 per GPU-hour region US West 2 · 32 offers low-priority $0.680	$3.3996
Azure form factor and memory not stated	A100 Standard_NC48ads_A100_v4	$7.35 per hour ÷ 2 GPUs = $3.6730 per GPU-hour region US East 2 · 642 offers spot $0.679	$3.6730

The silicon

vendor-published

Variant	Architecture	Memory	FP16 dense	Board power
A100 SXM	Ampere 2020	40 GB HBM2	312 TFLOPS	400 W
A100 PCIe	Ampere 2021	80 GB HBM2e	312 TFLOPS	300 W
A100 SXM	Ampere 2020	80 GB HBM2e	312 TFLOPS	400 W
A100	Ampere 2020	80 GB HBM2e	312 TFLOPS	400 W

Vendor-published figures. FP16 throughput is dense tensor throughput with no sparsity assumed; vendors often headline the sparse figure, which is twice as large. Vendor page ↗
2 of this chip's 6 variants carry no vendor specification here — they are priced all the same, and simply say nothing where a figure would go.

What they call it

Providers write the same hardware down differently. Every name below is one this index has seen for this chip; nothing was renamed to make the table tidier.

A100 SXM 40GBA100 PCIeA100A100 SXM