Text Model
Can I Run Fugaku-LLM 13B Locally?
Japanese scientific model
System Configuration
Configure your hardware to check compatibility
VRAM12GB
Bandwidth504 GB/s
TDP285W
System RAM32GB
Typededicated
Compatibility Result
Based on your selected hardware
Runs with Offload
VRAM Usage31.9GB / 12GB
Est. Speed~14.0 T/s
Context (KV)
23.08 GB
Disk Space
7.8 GB
62% of layers will be offloaded to system RAM. This will significantly reduce generation speed.