Skip to content
Llama Builds

Apple · Apple M3 Ultra · 2025

Apple Mac Studio M3 Ultra 512GB for local AI

The original 512GB Mac for giant models, now available only used and at volatile prices.

Updated · Speeds marked ~ are estimates; seemethodology

Unified memory
512GB
Bandwidth
819 GB/s
Power
480W
Runs well
15 models

M3 Ultra 512GB

Typically $9,499 at launch

Can the M3 Ultra 512GB run LLMs?

The M3 Ultra 512GB has 512GB of unified memory (about 384GB usable by the GPU by default) and 819 GB/s of memory bandwidth, which decides how big a model fits and how fast it generates text. It comfortably runs models up to about 320B parameters: the largest in our catalog is GLM-5.3-Flash at Q6_K (273GB with 8K context, ~17 tokens/sec).

Recommendations

Best models for the M3 Ultra 512GB

  1. Best overall · also coding, reasoning, vision

    GLM-5.3-Flash

    Q6_K · 273GB · ~17 tokens/sec

    Runs well
  2. Runner-up

    DeepSeek V4 Flash

    FP4 · 168GB · ~32 tokens/sec

    Runs well
  3. Fastest good model

    gpt-oss-20b

    MXFP4 · 15GB · ~80 tokens/sec

    Runs well
  4. Largest model that fits

    GLM-5.3

    Q3_K_M · 375GB · ~13 tokens/sec

    Fits, tight
Read: the best LLMs to run on the M3 Ultra 512GB

Compatibility

What runs on the M3 Ultra 512GB

Every current model in our catalog, at the best quantization that fits in the ~384GB the GPU can use with 8K tokens of context. "Partial offload" means part of the model runs from system RAM (we assume 64GB), which is much slower.

Which open-weight models run on the Apple Mac Studio M3 Ultra 512GB, with the best quantization and estimated speed
ModelParametersBest quantMemorySpeedVerdict
Gemma 4 E4B8BQ8_010 GB~44 tok/sRuns well
Qwen3.5 9B9BQ8_012 GB~39 tok/sRuns well
Phi-414.7BQ8_018 GB~28 tok/sRuns well
gpt-oss-20b20.9B (3.6B active)MXFP415 GB~80 tok/sRuns well
Gemma 4 26B A4B26B (3.8B active)Q8_030 GB~54 tok/sRuns well
Qwen3.8 27B27BQ8_032 GB~15 tok/sRuns well
Gemma 4 31B31BQ8_036 GB~14 tok/sRuns well
Qwen3.6 35B-A3B35B (3B active)Q8_041 GB~62 tok/sRuns well
GLM-4.5-Air106B (12B active)Q8_0118 GB~20 tok/sRuns well
Llama 4 Scout109B (17B active)Q8_0120 GB~14 tok/sRuns well
gpt-oss-120b117B (5.1B active)MXFP468 GB~70 tok/sRuns well
Qwen3.5 122B-A10B122B (10B active)Q8_0134 GB~23 tok/sRuns well
DeepSeek V4 Flash284B (13B active)FP4168 GB~32 tok/sRuns well
GLM-5.3-Flash320B (18B active)Q6_K273 GB~17 tok/sRuns well
GLM-5.3744B (40B active)Q3_K_M375 GB~13 tok/sFits, tight

Performance

M3 Ultra 512GB vs. alternatives on Qwen3.8 27B

Generation speed in tokens per second for a single user. Token generation is limited mostly by memory bandwidth, which is why bandwidth predicts these results so well.

  1. M5 Ultra 512GB

    Q8_0 · 512GB

    ~22tok/s

  2. M5 Ultra 256GB

    Q8_0 · 256GB

    ~22tok/s

  3. M3 Ultra 512GB

    Q8_0 · 512GB

    ~15tok/s

Estimated (method)

Measured

M3 Ultra 512GB benchmark results

ModelQuantRuntimeGenerationPromptSource
Llama 2 7B ChatQ4_0llama.cpp (Metal)92 tok/s1470 tok/sllama.cpp discussion #4167: Performance of llama.cpp on Apple Silicon M-series · October 2026
Llama 2 7B ChatQ8_0llama.cpp (Metal)64 tok/s1490 tok/sllama.cpp discussion #4167: Performance of llama.cpp on Apple Silicon M-series · October 2026
Llama 2 7B ChatF16llama.cpp (Metal)40 tok/s1540 tok/sllama.cpp discussion #4167: Performance of llama.cpp on Apple Silicon M-series · October 2026

Our take

Should you buy the M3 Ultra 512GB for AI?

The 2025 Mac Studio with M3 Ultra and 512GB was the first desktop that could hold DeepSeek-class models at 4 bit, with 819 GB/s of memory bandwidth. It made the Mac Studio a common choice for people running the largest open models without a GPU server. Apple removed the 512GB option in March 2026 during the memory shortage and replaced the line with M5 Ultra models in September. Prompt processing is slower than on the M5 Ultra, which adds GPU Neural Accelerators and about 50 percent more bandwidth.

What we like

  • 512GB of unified memory
  • 819 GB/s bandwidth
  • Quiet and efficient for its capacity

Watch out for

  • Discontinued, with volatile used prices
  • Slow prompt processing on long inputs
  • No CUDA support

Best for: Running DeepSeek-class models at 4 bit · Buyers who find one used below M5 Ultra pricing

Specifications

M3 Ultra 512GB specs that matter for AI

Memory
512GB LPDDR5 (unified)
GPU-usable memory
~384GB by default
Memory bandwidth
819 GB/s
Architecture
Apple M3 Ultra
Power
480W (system)
Interface
Thunderbolt 5 (no PCIe slots)
Released
2025
Launch price
$9,499
Software
Metal, MLX

macOS lets the GPU use about 75 percent of memory by default (about 384GB), and the iogpu.wired_limit_mb setting can raise it.

Sources: Apple Mac Studio (2025) tech specs, MacRumors: Apple cuts more Mac Studio and Mac mini RAM options, Apple Mac Studio power consumption and thermal output

Cross-shop

Alternatives to the M3 Ultra 512GB

Frequently asked questions

How much VRAM does the M3 Ultra 512GB have?

The Apple Mac Studio M3 Ultra 512GB has 512GB of unified memory (about 384GB usable by the GPU by default) with 819 GB/s of memory bandwidth.

What is the largest LLM the M3 Ultra 512GB can run?

Fully in GPU memory, the largest model in our catalog that runs comfortably is GLM-5.3-Flash (320B (18B active)) at Q6_K, using about 273GB with 8K context at ~17 tokens/sec.

What is the best LLM to run on the M3 Ultra 512GB?

Our top pick is GLM-5.3-Flash at Q6_K, which fits in 512GB with room for 8K of context and runs at ~17 tokens/sec. See our full list of the best models for the M3 Ultra 512GB for coding, reasoning, and vision picks.

Is the M3 Ultra 512GB good for local AI in 2026?

The original 512GB Mac for giant models, now available only used and at volatile prices.