AU price tracker › Cheapest way to run LFM2.5 24B-A2B (MoE)
Cheapest way to run LFM2.5 24B-A2B (MoE) in Australia
The cheapest single device we track that holds LFM2.5 24B-A2B (MoE) at Q4_K_M with an 8k context is the AMD Radeon AI PRO R9700 32GB at A$2,299 (Mwave). Expect roughly 455 tokens/sec (estimate).
Cheapest single devices that fit
Mac mini M5 Pro (16-core GPU) 24GB
Mac mini M5 Pro (20-core GPU) 24GB
Minisforum MS-S1 Max (Ryzen AI Max+ 395) 64GB
Mac Studio M5 Max (32-core GPU) 36GB
Minisforum MS-S1 Max (Ryzen AI Max+ 395) 128GB
HP Z2 Mini G1a (Ryzen AI Max PRO 390) 64GB
8 more on the full LFM2.5 24B-A2B (MoE) page.
Graphics card + system RAM (if you already have a PC)
These keep part of the model in system RAM. The total is the card plus a DDR5 kit only, and the speeds are optimistic estimates. How we estimate.
Intel Arc B580 12GB + 32GB DDR5
NVIDIA RTX 3060 12GB + 32GB DDR5
AMD Radeon RX 9060 XT 16GB + 32GB DDR5
NVIDIA RTX 5060 Ti 16GB + 32GB DDR5
AMD Radeon RX 9070 16GB + 32GB DDR5
Memory needed by quantisation (8k context)
FAQ
How much memory does LFM2.5 24B-A2B (MoE) need?
About 15.7 GB at Q4_K_M with an 8k context: 14.5 GB of weights, 0.17 GB of KV cache and 1 GB of overhead. It has 23.97B parameters, 2B active per token.
What's the cheapest way to run LFM2.5 24B-A2B (MoE) in Australia?
The cheapest single device we track that holds LFM2.5 24B-A2B (MoE) at Q4_K_M with an 8k context is the AMD Radeon AI PRO R9700 32GB at A$2,299 (Mwave). Expect roughly 455 tokens/sec (estimate). If you already have a PC, a Intel Arc B580 12GB plus 32GB of DDR5 (A$1,029 for the two) can run it partly from system RAM, more slowly.
Can a graphics card run LFM2.5 24B-A2B (MoE)?
Yes. The cheapest in-stock graphics card that holds it entirely in VRAM is the AMD Radeon AI PRO R9700 32GB at A$2,299.
Every device that runs LFM2.5 24B-A2B (MoE) →
More AU price guides
New model drops? Get the cheapest AU rig to run it.
One email a week: new open models, what they need, and the best AUD prices. No spam, unsubscribe anytime.
We only use your email to send the newsletter. Privacy