Run Qwen3 32B locally

Which workstation runs Qwen3 32B?

A dense 32B model with thinking and non-thinking modes. At 4-bit it needs about 20 GB of weights, so the question is less whether it fits and more how many people it can serve.

Parameters32.8B

Weights at 4-bit19 GB

Published formatBF16 (published checkpoint)

LicenceApache 2.0

ReleasedAlibaba Qwen · April 2025

Short answer

24 of 24 catalogued workstations pass the memory screen at 4-bit. The cheapest with a public price is the Framework Desktop · Ryzen AI Max+ (≈ $3.4k). On the NVIDIA DGX Spark, memory bandwidth caps one request at ≤ 13 tok/s. Documented recipes exist for NVIDIA GB10.

Every workstation, screened

Estimate · 8K context · 1 request

Machine	Memory	Needed at 4-bit	Speed ceiling	Highest precision that fits	Recipe	List price
Framework Desktop · Ryzen AI Max+AMD Ryzen AI Max	128 GB	32 GB Fits	Bandwidth not in record	BF16	None yet	≈ $3.4k
MINISFORUM MS-S1 MAXAMD Ryzen AI Max	128 GB	32 GB Fits	Bandwidth not in record	BF16	None yet	≈ $3.8k
NVIDIA DGX SparkNVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	≈ $4.7k
ASUS Ascent GX10NVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	≈ $5.3k
Acer Veriton GN100NVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	≈ $5.5k
MSI EdgeXpertNVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	≈ $6k
Dell Pro Max with GB10NVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	≈ $8.2k
Exxact Valence DGX StationNVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	≈ $95k
MSI XpertStation WS300NVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	≈ $109k
Dell Pro Max with GB300NVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	≈ $175k
NVIDIA DGX StationNVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	Price from the manufacturer
ASUS ExpertCenter Pro ET900N G3NVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	Price from the manufacturer
HP ZGX FuryNVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	Price from the manufacturer
GIGABYTE W775-V10-L01NVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	Price from the manufacturer
Supermicro Super AI Station · ARS-511GDNVIDIA GB300	252 GB	28 GB Fits	≤ 338 tok/s	BF16	None yet	Price from the manufacturer
Apple Mac Studio · M3 UltraApple Silicon	96 GB	32 GB Fits	≤ 39 tok/s	BF16	None yet	Price from the manufacturer
HP ZGX Nano G1nNVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	Price from the manufacturer
Lenovo ThinkStation PGXNVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	Price from the manufacturer
GIGABYTE AI TOP ATOMNVIDIA GB10	128 GB	32 GB Fits	≤ 13 tok/s	BF16	Vendor-listed validationSGLang · NVFP4	Price from the manufacturer
AMD Ryzen AI HaloAMD Ryzen AI Max	128 GB	32 GB Fits	Bandwidth not in record	BF16	None yet	Price from the manufacturer
HP Z8 Fury G6iNVIDIA RTX PRO	96 GB	28 GB Fits	Bandwidth not in record	BF16	None yet	Price from the manufacturer
Lenovo ThinkStation P7NVIDIA RTX PRO	96 GB	28 GB Fits	Bandwidth not in record	BF16	None yet	Price from the manufacturer
HP Z2 Mini G1aAMD Ryzen AI Max	128 GB	32 GB Fits	Bandwidth not in record	BF16	None yet	Price from the manufacturer
Apple Mac Studio · M5 UltraApple Silicon	96 GB	32 GB Fits	Bandwidth not in record	BF16	None yet	Preorder · price from the manufacturer

Fit: weights at 4-bit plus KV cache for 8K tokens and a runtime reserve, against 90% of one memory tier. Speed ceiling: memory bandwidth divided by the bytes read per generated token. Neither is a measured result. Method · Change the context, users or precision in the finder

Documented configurations

Sourced

Vendor-listed validation

NVIDIA DGX Spark

SGLang · NVFP4

nvidia/Qwen3-32B-FP4

--quantization modelopt_fp4

NVIDIA source

Questions people ask

How much memory does Qwen3 32B need?

About 19 GB for the weights at 4-bit, plus the KV cache and runtime reserve: roughly 32 GB in total at 8K context and one request. Longer context and more simultaneous users need more.

What is the cheapest workstation that runs Qwen3 32B?

In the Lab’s catalogue, the Framework Desktop · Ryzen AI Max+ (≈ $3.4k, Supplier list price · United States · Sept 2026) passes the memory screen at 4-bit.

How fast does Qwen3 32B run locally?

The Lab has no measured run yet. The memory-bandwidth ceiling for one request is ≤ 13 tok/s on the NVIDIA DGX Spark; real single-stream speed lands below the ceiling.

Other models

Run gpt-oss-120b locally Run Llama 3.3 70B Instruct locally Run Qwen3 235B-A22B locally

Head to head

NVIDIA DGX Spark vs Apple Mac Studio · M3 Ultra NVIDIA DGX Spark vs Apple Mac Studio · M5 Ultra NVIDIA DGX Spark vs Framework Desktop · Ryzen AI Max+ NVIDIA DGX Spark vs MINISFORUM MS-S1 MAX NVIDIA DGX Spark vs HP Z2 Mini G1a NVIDIA DGX Spark vs AMD Ryzen AI Halo Framework Desktop · Ryzen AI Max+ vs Apple Mac Studio · M3 Ultra Framework Desktop · Ryzen AI Max+ vs Apple Mac Studio · M5 Ultra HP ZGX Nano G1n vs HP Z2 Mini G1a

Ran Qwen3 32B on one of these machines? Publish your run with the exact model revision, runtime version, context and tokens per second. Measured results replace the estimates on this page.