Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.
Run it locally
Inference · memory estimate
Qwen2.5-7B-Instruct
7.62 B total parameters · qwen2 · BF16
Published checkpoint tensor payload: 14.2 GiB. This includes stored copies and buffers; it is separate from the runtime estimates below.
No catalogued Local AI system meets this memory estimate with the reserved headroom.
Shared-memory systems use a planning budget of 75% of installed memory, leaving 25% for the OS and other allocations. This is an assumption, not a measured GPU allocation. Firmware and driver limits may be lower and may require configuration. Memory matches do not verify a runtime, quantized model artifact or inference speed.
Includes FP16 KV cache, prompt plus generated tokens, quantization metadata and a runtime allowance. GPU matches reserve 10% of VRAM. Memory fit is not a speed or software-compatibility guarantee; quantized weights and runtime support must be available. Cache uses a conservative full-attention upper bound.
API cost
USD / month
Standard text-token estimate. Excludes taxes, caching, batch discounts, reasoning and multimodal surcharges. Provider limits and regional availability may differ.