Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.
Run it locally
Inference · memory estimate
DeepSeek-R1-Distill-Qwen-32B
32.76 B total parameters · qwen2 · BF16
Published checkpoint tensor payload: 61.0 GiB. This includes stored copies and buffers; it is separate from the runtime estimates below.
No catalogued Local AI system meets this memory estimate with the reserved headroom.
Shared-memory systems use a planning budget of 75% of installed memory, leaving 25% for the OS and other allocations. This is an assumption, not a measured GPU allocation. Firmware and driver limits may be lower and may require configuration. Memory matches do not verify a runtime, quantized model artifact or inference speed.
Includes FP16 KV cache, prompt plus generated tokens, quantization metadata and a runtime allowance. GPU matches reserve 10% of VRAM. Memory fit is not a speed or software-compatibility guarantee; quantized weights and runtime support must be available. Cache uses a conservative full-attention upper bound.