LocalOps

Check Another GPU

Can the NVIDIA H100 SXM Run Local AI?

Detailed AI compatibility report for NVIDIA H100 SXM. Specifications, VRAM analysis, and model performance benchmarks.

VRAM
80GB
Bandwidth
3350 GB/s
Compatible Models
455
Runs with Offload
7

Top Compatible Models for NVIDIA H100 SXM

Ministral 3 14B

~80.0 T/s

Uses 34.4GB VRAM

Ministral 3 8B

~120.0 T/s

Uses 20.2GB VRAM

Ministral 3 3B

~200.0 T/s

Uses 8.6GB VRAM

Llama 3.2 11B Vision

~120.0 T/s

Uses 26.2GB VRAM

Llama 3.2 3B

~200.0 T/s

Uses 8.9GB VRAM

Llama 3.2 1B

~200.0 T/s

Uses 3.9GB VRAM

Llama 3.1 8B

~120.0 T/s

Uses 20.3GB VRAM

Qwen 2.5 32B

~50.0 T/s

Uses 77.2GB VRAM

Qwen 2.5 14B

~80.0 T/s

Uses 35.5GB VRAM

Check All 531 Models on Hardware Builder
Buy Me A Coffee
Buy Me A Coffee