NVIDIA·Datacenter
H100
NVIDIA Hopper architecture GPU designed for generative AI and large language models at data center scale.
Cloud rental pricing
Estimated / month
$1,857
Hourly
$2.54/hr
Data source
Vast.ai
Market range
$299 – $4,679
- MSRP
- $25,000
- Availability
- limited
- Providers
- 13
- Reliability
- 1%
Last price update 9/18/2026, 2:00:28 AM
Hardware specifications
- Architecture
- Hopper
- Release
- March 2022
- Memory
- 80 GB
- Memory type
- HBM3
- CUDA cores
- 16,896
- TDP
- 700W
Features
- Transformer Engine
- NVLink
- FP8 precision
- Confidential computing
Use cases
- LLM training
- Generative AI
- Recommendation systems
- Real-time inference
Strengths
- • Fastest NVIDIA datacenter GPU
- • Optimized for transformers
- • High throughput
Considerations
- • Very expensive
- • Limited availability
- • High power and cooling requirements
Typical cloud instance specs
Averages from marketplace listings when rental data is available.
- CPU cores
- 107
- System RAM
- 608712 GB
- Disk
- 2026 GB
- Download
- 8515 Mbps
- Upload
- 8536 Mbps
- CUDA
- 13.3
- DL perf
- 739.4
- CPU
- AMD EPYC 9554 64-Core Processor
Price summary
- Low
- $1,023
- Average
- $2,350
- High
- $3,286
Price history
| Date | Price / mo | Source |
|---|---|---|
| 9/18/2026, 2:00:28 AM | $1,857 | Vast.ai |
| 9/17/2026, 2:00:34 PM | $1,857 | Vast.ai |
| 9/17/2026, 2:00:27 AM | $1,857 | Vast.ai |
| 9/16/2026, 2:00:33 PM | $1,857 | Vast.ai |
| 9/16/2026, 2:00:28 AM | $1,857 | Vast.ai |
| 9/15/2026, 2:00:32 PM | $1,857 | Vast.ai |
| 9/15/2026, 2:00:29 AM | $1,857 | Vast.ai |
| 9/14/2026, 2:00:32 PM | $1,857 | Vast.ai |
| 9/14/2026, 2:00:32 AM | $1,857 | Vast.ai |
| 9/13/2026, 2:00:34 PM | $1,857 | Vast.ai |
| 9/13/2026, 2:00:32 AM | $1,857 | Vast.ai |
| 9/12/2026, 2:00:33 PM | $1,857 | Vast.ai |
| 9/12/2026, 2:00:34 AM | $1,932 | Vast.ai |
| 9/11/2026, 2:00:34 PM | $1,932 | Vast.ai |
| 9/11/2026, 2:00:28 AM | $1,932 | Vast.ai |
| 9/10/2026, 2:00:33 PM | $1,932 | Vast.ai |
| 9/10/2026, 2:00:29 AM | $1,932 | Vast.ai |
| 9/9/2026, 2:00:32 PM | $1,932 | Vast.ai |
| 9/9/2026, 2:00:29 AM | $1,932 | Vast.ai |
| 9/8/2026, 2:00:32 PM | $1,932 | Vast.ai |