Recommendations · October 2026
The best local LLMs for the Ryzen AI Max+ PRO 495
Every model worth running on 192GB of unified memory (about 144GB usable by the GPU by default), which quantization to pick, and how fast each one generates text.
Our picks at a glance
- Best overall (also coding, reasoning, vision): Qwen3.6 35B-A3B (Q8_0, ~32 tokens/sec)
- Runner-up (also largest that fits): Qwen3.5 122B-A10B (Q6_K, ~14 tokens/sec)
- Fastest good model: gpt-oss-20b (MXFP4, ~43 tokens/sec)
We may earn a commission when you buy through links on this page. It never changes what we recommend. How we make money
01 · Best overall · also coding, reasoning, vision
Qwen3.6 35B-A3B
Qwen3.6 35B-A3B (35B (3B active)) fits comfortably in the Ryzen AI Max+ PRO 495's memory at Q8_0, using about 41GB with 8K context and generating ~32 tokens/sec. It is the most capable model in our catalog that runs well on this card. It is also our top pick for coding, reasoning and working with images.
Qwen3.6 35B-A3B is the April 2026 refresh of Qwen's fast mixture-of-experts model, focused on agentic coding and on preserving its reasoning across multi-turn tool use. With only 3B active parameters it generates text very quickly, and its hybrid linear attention keeps the KV cache tiny: the full 262K context needs about 5GB. At Q4_K_M it needs about 24GB with 8K context, which is tight on a 24GB card and comfortable on 32GB GPUs and Macs with 36GB or more; 12GB to 16GB GPUs run it well with experts offloaded to system RAM. It replaces Qwen3 30B-A3B and Qwen3 Coder 30B-A3B for most local users.
- Quantization
- Q8_0
- Memory used
- 41.0 GB
- Speed (est.)
- ~32 tok/s
- Max context
- ~256K
$ ollama run qwen3.6:35bModel details →02 · Runner-up · also largest that fits
Qwen3.5 122B-A10B
Qwen3.5 122B-A10B (122B (10B active)) fits comfortably in the Ryzen AI Max+ PRO 495's memory at Q6_K, using about 104GB with 8K context and generating ~14 tokens/sec. It is the next-best model that runs well here, and the one to try if the top pick doesn't suit you. It is also the largest model that runs fully on this GPU.
Qwen3.5 122B-A10B is the mid-size mixture-of-experts model from Qwen's February 2026 Qwen3.5 launch, with 10B active parameters, image input, a 262K context, and switchable thinking. Later Qwen releases refreshed the 27B and 35B-A3B sizes, so this remains Qwen's main model for 96GB to 128GB machines. It needs about 77GB at Q4_K_M with 8K context, which suits Macs with 96GB or more, Strix Halo 128GB systems, and DGX Spark; a 24GB GPU needs 96GB or more of system RAM to hold the offloaded experts. Its hybrid attention keeps the KV cache small, so long contexts are cheap.
- Quantization
- Q6_K
- Memory used
- 104.5 GB
- Speed (est.)
- ~14 tok/s
- Max context
- ~256K
$ ollama run qwen3.5:122bModel details →03 · Fastest good model
gpt-oss-20b
gpt-oss-20b (20.9B (3.6B active)) fits comfortably in the Ryzen AI Max+ PRO 495's memory at MXFP4, using about 15GB with 8K context and generating ~43 tokens/sec. Pick it when responsiveness matters more than squeezing out maximum quality.
gpt-oss-20b is OpenAI's small open-weight reasoning model, a 21B mixture-of-experts with 3.6B active parameters whose expert weights ship natively in 4-bit MXFP4. OpenAI has not released a successor, and it remains one of the best reasoning and tool-calling models that fits a 16GB GPU. The native weights take about 14GB, so 16GB cards and Macs with 24GB or more run it fully in memory, and 12GB cards run it with a little CPU offload. Reasoning effort is adjustable (low, medium, high) but cannot be turned off.
- Quantization
- MXFP4
- Memory used
- 15.0 GB
- Speed (est.)
- ~43 tok/s
- Max context
- ~128K
$ ollama run gpt-oss:20bModel details →The full list
Every model that runs on the Ryzen AI Max+ PRO 495
| # | Model | Best quant | Memory | Speed | Fit |
|---|---|---|---|---|---|
| 1 | Qwen3.6 35B-A3B35B (3B active) | Q8_0 | 41.0 GB | ~32 tok/s | Runs well |
| 2 | Qwen3.5 122B-A10B122B (10B active) | Q6_K | 104.5 GB | ~14 tok/s | Runs well |
| 3 | gpt-oss-120b117B (5.1B active) | MXFP4 | 68.3 GB | ~37 tok/s | Runs well |
| 4 | Gemma 4 26B A4B26B (3.8B active) | Q8_0 | 29.5 GB | ~27 tok/s | Runs well |
| 5 | Qwen3.8 27B27B | Q8_0 | 31.6 GB | ~6.9 tok/s | Runs well |
| 6 | Gemma 4 31B31B | Q8_0 | 35.9 GB | ~6.2 tok/s | Runs well |
| 7 | gpt-oss-20b20.9B (3.6B active) | MXFP4 | 15.0 GB | ~43 tok/s | Runs well |
| 8 | Qwen3.5 9B9B | Q8_0 | 12.0 GB | ~18 tok/s | Runs well |
| 9 | GLM-4.5-Air106B (12B active) | Q8_0 | 118.1 GB | ~9.3 tok/s | Runs well |
| 10 | Gemma 4 E4B8B | Q8_0 | 10.5 GB | ~21 tok/s | Runs well |
| 11 | Phi-414.7B | Q8_0 | 18.3 GB | ~13 tok/s | Runs well |
| 12 | Llama 4 Scout109B (17B active) | Q8_0 | 120.2 GB | ~6.7 tok/s | Runs well |
Ranked by our capability score, adjusted for quantization and speed. Memory includes 8K context. Speeds are estimates for a single user; seemethodology.
Limits
Popular models that don't run well on 192GB
- DeepSeek V4 FlashWon't fit
Needs about 168GB at FP4 with 8K context. It does not fit, even with CPU offload. See what hardware it needs.
- GLM-5.3-FlashWon't fit
Needs about 201GB at Q4_K_M with 8K context. It does not fit, even with CPU offload. See what hardware it needs.
- GLM-5.3Won't fit
Needs about 466GB at Q4_K_M with 8K context. It does not fit, even with CPU offload. See what hardware it needs.
Setup
Best settings and software for the Ryzen AI Max+ PRO 495
Radeon support has improved a lot, but expect a little more setup than on NVIDIA. With Qwen3.6 35B-A3B at Q8_0, you can fit roughly 256K tokens of context with a 16-bit KV cache; an 8-bit KV cache about doubles that.
- LM Studio or Ollama: both support Radeon through ROCm or Vulkan.
- llama.cpp (Vulkan): often the least-friction backend on AMD and very competitive on speed.
- llama.cpp (ROCm/HIP): fastest prompt processing on supported cards under Linux.
- vLLM (ROCm): for multi-user serving on supported Instinct and Radeon PRO cards.
New to quantization? Q4_K_M is the safe default; read our quantization explainer to see when Q5, Q6, or Q8 is worth the extra memory.
Upgrade path
Need more memory?
Memory capacity decides which models you can run. These are the most popular options with more memory than the Ryzen AI Max+ PRO 495.
Frequently asked questions
What is the best LLM for the Ryzen AI Max+ PRO 495?
Qwen3.6 35B-A3B is the best all-round model for the Ryzen AI Max+ PRO 495. At Q8_0 it uses about 41GB with 8K context and generates ~32 tokens/sec.
What quantization should I use on the Ryzen AI Max+ PRO 495?
Use the highest-precision quant that leaves room for your context. Q4_K_M is the best default: it is about a quarter the size of the original 16-bit weights with only a small quality loss. If a model fits at Q5_K_M, Q6_K, or Q8_0 with room to spare, use that instead. Avoid going below Q3 except for very large models.
How much context can I use with Qwen3.6 35B-A3B on the Ryzen AI Max+ PRO 495?
At Q8_0 with a 16-bit KV cache, roughly 256K tokens fit in 192GB unified memory. Quantizing the KV cache to 8-bit (for example with llama.cpp's --cache-type-k q8_0 --cache-type-v q8_0) roughly doubles that.
Can the Ryzen AI Max+ PRO 495 run DeepSeek V4 Flash?
No. DeepSeek V4 Flash needs about 168GB at FP4 with 8K context, which is far more than 192GB unified memory.
Can the Ryzen AI Max+ PRO 495 run GLM-5.3-Flash?
No. GLM-5.3-Flash needs about 201GB at Q4_K_M with 8K context, which is far more than 192GB unified memory.