Models › Ling 3.1 flash (MoE)
Can I run Ling 3.1 flash (MoE) in Australia?
Not on a single device we track at Q4_K_M. You would need multiple GPUs or a smaller quantisation.
Memory needed by quantisation (8k context)
| Quant | Weights | Total needed | Cheapest hardware that fits |
|---|---|---|---|
Q4_K_M | 346.8 GB | 348.5 GB | nothing we track (with a price) |
Q5_K_M | 406.9 GB | 408.6 GB | nothing we track (with a price) |
Q6_K | 469.1 GB | 470.8 GB | nothing we track (with a price) |
Q8_0 | 607.9 GB | 609.6 GB | nothing we track (with a price) |
F16 | 1144.2 GB | 1145.9 GB | nothing we track (with a price) |
All hardware that fits at Q4_K_M
| Hardware | Needs / usable | Est. tok/s | Price | Retailer link |
|---|---|---|---|---|
| Nothing we track fits. | ||||
The tok/s figures are bandwidth-based estimates for this model. Where a device has a measured benchmark, the estimate is calibrated to that run. They are not measurements. Methodology.
Graphics card + system RAM (MoE experts in RAM)
Mixture-of-experts models only read a few experts per token, so llama.cpp can keep the expert weights in system RAM and everything else on the GPU (e.g. --n-cpu-moe / -ot exps=CPU). That lets a 12–32GB card run a much bigger model.
All figures below are estimates (Q4_K_M, 8k context, dual-channel DDR5-5600). How we estimate.
| Graphics card | Card price | GPU only | + 32GB RAM | + 64GB RAM | + 128GB RAM |
|---|---|---|---|---|---|
| No graphics card we track can run it even with 128GB of RAM. | |||||
DDR5 kit prices today: 32GB: A$610 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 64GB: A$1,499 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 128GB: A$2,511 (Mwave, not in stock online, checked 20 Oct 2026, 7:44 am AEST). Card + kit only; the rest of the PC isn't included. RAM-offload speeds are estimates and can be optimistic, so check community results below.
Community measured
No reader results yet. Be the first to submit one →
Try other quantisations and context lengths in the Can I run it? tool → · Submit your own Ling 3.1 flash (MoE) benchmark →