Models › Nemotron 3.5 Lightning 30B-A3B (MoE)

Can I run Nemotron 3.5 Lightning 30B-A3B (MoE) in Australia?

Yes. The cheapest hardware we track that holds Nemotron 3.5 Lightning 30B-A3B (MoE) at Q4_K_M with an 8k context is the AMD Radeon AI PRO R9700 32GB at A$2,299 (Mwave, checked 20 Oct 2026, 7:38 am AEST). Expect roughly 304 tokens/sec (estimate).

NVIDIA · released 1 Aug 2026 · 0.7M HF downloads (last 30 days)

No GGUF build found yet on unsloth / bartowski / ggml-org (checked daily).

Memory needed by quantisation (8k context)

All hardware that fits at Q4_K_M

The tok/s figures are bandwidth-based estimates for this model. Where a device has a measured benchmark, the estimate is calibrated to that run. They are not measurements. Methodology.

Graphics card + system RAM (MoE experts in RAM)

Mixture-of-experts models only read a few experts per token, so llama.cpp can keep the expert weights in system RAM and everything else on the GPU (e.g. --n-cpu-moe / -ot exps=CPU). That lets a 12–32GB card run a much bigger model. All figures below are estimates (Q4_K_M, 8k context, dual-channel DDR5-5600). How we estimate.

DDR5 kit prices today: 32GB: A$610 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 64GB: A$1,499 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 128GB: A$2,511 (Mwave, not in stock online, checked 20 Oct 2026, 7:44 am AEST). Card + kit only; the rest of the PC isn't included. RAM-offload speeds are estimates and can be optimistic, so check community results below.

Community measured

No reader results yet. Be the first to submit one →

Try other quantisations and context lengths in the Can I run it? tool → · Submit your own Nemotron 3.5 Lightning 30B-A3B (MoE) benchmark →