Models › Mistral 7B Instruct v0.3
Can I run Mistral 7B Instruct v0.3 in Australia?
Yes. The cheapest hardware we track that holds Mistral 7B Instruct v0.3 at Q4_K_M with an 8k context is the Intel Arc B580 12GB at A$419 (Scorptec, checked 20 Oct 2026, 7:44 am AEST). Expect roughly 61 tokens/sec (estimate).
Memory needed by quantisation (8k context)
| Quant | Weights | Total needed | Cheapest hardware that fits |
|---|---|---|---|
Q4_K_M | 4.4 GB | 6.5 GB | Intel Arc B580 12GB · A$419 |
Q5_K_M | 5.2 GB | 7.2 GB | Intel Arc B580 12GB · A$419 |
Q6_K | 5.9 GB | 8.0 GB | Intel Arc B580 12GB · A$419 |
Q8_0 | 7.7 GB | 9.8 GB | Intel Arc B580 12GB · A$419 |
F16 | 14.5 GB | 16.6 GB | AMD Radeon AI PRO R9700 32GB · A$2,299 |
All hardware that fits at Q4_K_M
| Hardware | Needs / usable | Est. tok/s | Price | Retailer link |
|---|---|---|---|---|
6.5 / 11.5 GB fits | 61 estimate | A$419 Scorptec checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 11.5 GB fits | 65 estimate | A$539 Scorptec checked 20 Oct 2026, 7:38 am AEST | ||
6.5 / 15.5 GB fits | 58 estimate | A$699 Mwave checked 20 Oct 2026, 7:38 am AEST | ||
6.5 / 15.5 GB fits | 78 estimate | A$1,099 Scorptec checked 20 Oct 2026, 7:39 am AEST | ||
6.5 / 15.5 GB fits | 103 estimate | A$1,099 Mwave checked 20 Oct 2026, 7:38 am AEST | ||
6.5 / 15.5 GB fits | 118 estimate | A$1,169 Mwave checked 20 Oct 2026, 7:38 am AEST | ||
6.5 / 11.5 GB fits | 110 estimate | A$1,249 Scorptec checked 20 Oct 2026, 7:39 am AEST | ||
6.5 / 12.0 GB fits | 26 estimate | A$1,449 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 12.0 GB fits | 21 estimate | A$1,597 Mwave checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 15.5 GB fits | 153 estimate | A$1,699 Scorptec checked 20 Oct 2026, 7:40 am AEST | ||
6.5 / 15.5 GB fits | 157 estimate | A$2,299 Scorptec checked 20 Oct 2026, 7:40 am AEST | ||
6.5 / 31.5 GB fits | 126 estimate | A$2,299 Mwave checked 20 Oct 2026, 7:38 am AEST | ||
6.5 / 18.0 GB fits | 58 estimate | A$2,699 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 18.0 GB fits | 57 estimate | A$2,999 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 23.5 GB fits | 148 estimate | A$3,599 Scorptec · not in stock online checked 20 Oct 2026, 7:41 am AEST | ||
6.5 / 48.0 GB fits | 43 estimate | A$3,915 Minisforum AU · not in stock online checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 27.0 GB fits | 78 estimate | A$4,299 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 96.0 GB fits | 43 estimate | A$5,719 Minisforum AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 48.0 GB fits | 43 estimate | A$5,894 Mwave checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 48.0 GB fits | 51 estimate | A$7,149 Microsoft Store AU · stale checked 19 Oct 2026, 8:18 pm AEST | ||
6.5 / 96.0 GB fits | 43 estimate | A$8,999 Mwave · not in stock online checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 96.0 GB fits | 49 estimate | A$8,999 Mwave checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 72.0 GB fits | 202 estimate | A$9,499 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 96.0 GB fits | 51 estimate | A$9,649 Microsoft Store AU · stale checked 19 Oct 2026, 8:18 pm AEST | ||
6.5 / 31.5 GB fits | 250 estimate | A$10,999 Scorptec checked 20 Oct 2026, 7:41 am AEST | ||
6.5 / 192.0 GB fits | 154 estimate | A$11,449 Apple AU checked 20 Oct 2026, 7:44 am AEST | ||
6.5 / 95.5 GB fits | 237 estimate | A$27,599 Scorptec checked 20 Oct 2026, 7:42 am AEST | ||
6.5 / 15.5 GB fits | 49 estimate | price unavailable | ||
6.5 / 23.5 GB fits | 136 estimate | price unavailable | ||
6.5 / 23.5 GB fits | 161 estimate | price unavailable | ||
6.5 / 23.5 GB fits | 158 estimate | price unavailable | ||
6.5 / 36.0 GB fits | 103 estimate | price unavailable | ||
6.5 / 48.0 GB fits | 43 estimate | price unavailable | ||
6.5 / 96.0 GB fits | 43 estimate | price unavailable |
The tok/s figures are bandwidth-based estimates for this model. Where a device has a measured benchmark, the estimate is calibrated to that run. They are not measurements. Methodology.
Graphics card + system RAM (partial layer offload)
Dense models can split layers between GPU and system RAM, but every token reads all the weights, so the RAM part is slow. All figures below are estimates (Q4_K_M, 8k context, dual-channel DDR5-5600). How we estimate.
| Graphics card | Card price | GPU only | + 32GB RAM | + 64GB RAM | + 128GB RAM |
|---|---|---|---|---|---|
A$419 | fits ~61 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$539 | fits ~65 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$699 | fits ~58 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$1,099 | fits ~78 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$1,099 | fits ~103 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$1,169 | fits ~118 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$1,249 | fits ~110 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$1,699 | fits ~153 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$2,299 | fits ~157 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$2,299 | fits ~126 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$3,599 | fits ~148 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$10,999 | fits ~250 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
A$27,599 | fits ~237 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
n/a | fits ~49 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
n/a | fits ~136 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
n/a | fits ~161 tok/s | fits in VRAM | fits in VRAM | fits in VRAM | |
n/a | fits ~158 tok/s | fits in VRAM | fits in VRAM | fits in VRAM |
DDR5 kit prices today: 32GB: A$610 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 64GB: A$1,499 (Mwave, checked 20 Oct 2026, 7:44 am AEST) · 128GB: A$2,511 (Mwave, not in stock online, checked 20 Oct 2026, 7:44 am AEST). Card + kit only; the rest of the PC isn't included. RAM-offload speeds are estimates and can be optimistic, so check community results below.
Community measured
No reader results yet. Be the first to submit one →
Try other quantisations and context lengths in the Can I run it? tool → · Submit your own Mistral 7B Instruct v0.3 benchmark →