Models › Nemotron 3.5 Bolt 74B-A9B (MoE)
Can I run Nemotron 3.5 Bolt 74B-A9B (MoE) in Australia?
Yes. The cheapest hardware we track that holds Nemotron 3.5 Bolt 74B-A9B (MoE) at Q4_K_M with an 8k context is the Minisforum MS-S1 Max (Ryzen AI Max+ 395) 128GB at A$5,719 (Minisforum AU, checked 20 Oct 2026, 7:44 am AEST). Expect roughly 35 tokens/sec (estimate).
GGUF-only repo (NVIDIA ships a ~22 GB file built for 24 GB cards); Mamba-hybrid KV cache is not modelled.
Memory needed by quantisation (8k context)
| Quant | Weights | Total needed | Cheapest hardware that fits |
|---|---|---|---|
Q4_K_M | 44.9 GB | 45.9 GB | |
Q5_K_M | 52.7 GB | 53.7 GB | |
Q6_K | 60.7 GB | 61.7 GB | |
Q8_0 | 78.7 GB | 79.7 GB | |
F16 | 148.1 GB | 149.1 GB | Mac Studio M5 Ultra (80-core GPU) 256GB · A$11,449 |
All hardware that fits at Q4_K_M
| Hardware | Needs / usable | Est. tok/s | Price | Retailer link |
|---|---|---|---|---|
45.9 / 48.0 GB tight | 35 estimate | A$3,915 Minisforum AU · not in stock online checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 96.0 GB fits | 35 estimate | A$5,719 Minisforum AU checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 48.0 GB tight | 35 estimate | A$5,894 Mwave checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 48.0 GB tight | 41 estimate | A$7,149 Microsoft Store AU · stale checked 19 Oct 2026, 8:18 pm AEST | ||
45.9 / 96.0 GB fits | 35 estimate | A$8,999 Mwave · not in stock online checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 96.0 GB fits | 40 estimate | A$8,999 Mwave checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 72.0 GB fits | 163 estimate | A$9,499 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 96.0 GB fits | 41 estimate | A$9,649 Microsoft Store AU · stale checked 19 Oct 2026, 8:18 pm AEST | ||
45.9 / 192.0 GB fits | 124 estimate | A$11,449 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
45.9 / 95.5 GB fits | 191 estimate | A$27,599 Scorptec checked 20 Oct 2026, 7:42 am AEST | ||
45.9 / 48.0 GB tight | 35 estimate | price unavailable | ||
45.9 / 96.0 GB fits | 35 estimate | price unavailable |
The tok/s figures are bandwidth-based estimates for this model. Where a device has a measured benchmark, the estimate is calibrated to that run. They are not measurements. Methodology.
Graphics card + system RAM
Offload sizing not available: we couldn't read this model's expert layout from config.json.
Community measured
No reader results yet. Be the first to submit one →
Try other quantisations and context lengths in the Can I run it? tool → · Submit your own Nemotron 3.5 Bolt 74B-A9B (MoE) benchmark →