Hardware › NVIDIA RTX 4060 Ti 16GB
NVIDIA RTX 4060 Ti 16GB for local AI: price in Australia & what it can run
price unavailableno AU retailer price found
16 GBVRAM (15.5 GB usable)
288 GB/smemory bandwidth
56 tok/sestimated, Llama 2 7B Q4_0
The CUDA scoreboard only lists the 8GB 4060 Ti (63.86 tok/s); same 288 GB/s bandwidth, so expect similar speed on models that fit in 8GB.
Benchmark
No public benchmark found for this exact hardware. Speeds on this page are bandwidth-based estimates using a median efficiency of 74%.
Specs: NVIDIA published specification (manually entered)
AU prices found
Price unavailable: no matching listing at the retailers we can check.
Community measured
No reader results yet. Be the first to submit one →
Which models fit? (8k context)
| Model | Quant | Needs / usable | Fit | Est. tok/s |
|---|---|---|---|---|
Q4_K_M | 464.4 / 15.5 GB | no | – | |
Q4_K_M | 499.4 / 15.5 GB | no | – | |
Q4_K_M | 20.0 / 15.5 GB | no | – | |
Q4_K_M | 348.5 / 15.5 GB | no | – | |
Q4_K_M | 15.7 / 15.5 GB | no | – | |
Q4_K_M | 45.9 / 15.5 GB | no | – | |
Q4_K_M | 22.5 / 15.5 GB | no | – | |
Q4_K_M | 305.3 / 15.5 GB | no | – | |
MiniCPM V 4.7 1B new | Q4_K_M | 2.0 / 15.5 GB | fits | 227 estimate |
Q4_K_M | 464.4 / 15.5 GB | no | – | |
Q4_K_M | 195.9 / 15.5 GB | no | – | |
GLM 5.3 (MoE) new | Q4_K_M | 458.4 / 15.5 GB | no | – |
Q4_K_M | 110.3 / 15.5 GB | no | – | |
Q4_K_M | 18.4 / 15.5 GB | no | – | |
Q4_K_M | 20.2 / 15.5 GB | no | – | |
Q4_K_M | 9.1 / 15.5 GB | fits | 29 estimate | |
Q4_K_M | 23.0 / 15.5 GB | no | – | |
Q4_K_M | 81.4 / 15.5 GB | no | – | |
Q4_K_M | 22.1 / 15.5 GB | no | – | |
Q4_K_M | 17.2 / 15.5 GB | no | – | |
Q4_K_M | 6.0 / 15.5 GB | fits | 44 estimate | |
Q4_K_M | 7.1 / 15.5 GB | fits | 36 estimate | |
Q4_K_M | 4.1 / 15.5 GB | fits | 76 estimate | |
Q4_K_M | 77.0 / 15.5 GB | no | – | |
Q4_K_M | 20.4 / 15.5 GB | no | – | |
gpt-oss 20B (MoE) older | MXFP4 | 12.4 / 15.5 GB | fits | 112 estimate |
gpt-oss 120B (MoE) older | MXFP4 | 63.5 / 15.5 GB | no | – |
Qwen 3 4B older | Q4_K_M | 4.6 / 15.5 GB | fits | 88 estimate |
Qwen 3 8B older | Q4_K_M | 7.2 / 15.5 GB | fits | 43 estimate |
Qwen 3 32B older | Q4_K_M | 23.0 / 15.5 GB | no | – |
Llama 3.1 8B Instruct older | Q4_K_M | 6.9 / 15.5 GB | fits | 44 estimate |
Mistral 7B Instruct v0.3 older | Q4_K_M | 6.5 / 15.5 GB | fits | 49 estimate |