Can the AMD Instinct MI100 Run Local AI?
Detailed AI compatibility report for AMD Instinct MI100. Specifications, VRAM analysis, and model performance benchmarks.
VRAM
32GB
Bandwidth
1229 GB/s
Compatible Models
398
Runs with Offload
35
Top Compatible Models for AMD Instinct MI100
Ministral 3 8B
~120.0 T/sUses 20.2GB VRAM
Ministral 3 3B
~200.0 T/sUses 8.6GB VRAM
Llama 3.2 11B Vision
~120.0 T/sUses 26.2GB VRAM
Llama 3.2 3B
~200.0 T/sUses 8.9GB VRAM
Llama 3.2 1B
~200.0 T/sUses 3.9GB VRAM
Llama 3.1 8B
~120.0 T/sUses 20.3GB VRAM
Qwen 2.5 7B
~120.0 T/sUses 19.6GB VRAM
Qwen 2.5 3B
~200.0 T/sUses 8.7GB VRAM
Qwen 2.5 1.5B
~200.0 T/sUses 5.3GB VRAM
