GeekRadar / The comparison desk
COMPARE.
AI models
alibaba

Qwen3.7 Max

AI model Released

Context window
1,000,000 tokens
Maximum output
131,072 tokens
Open weights
No

Benchmark results

  • $OneMillion-Bench (expert score) · version unreported · reported score44.40*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Judge
    gemini-3.1-pro-preview*
  • Agents' Last Exam (Pass / Score) · version unreported · Pass11.80*Platform unreported Compare results
    Test conditions
    Metric
    Pass*
    Checkpoint version
    Not specified*
  • Agents' Last Exam (Pass / Score) · version unreported · Score31.10*Platform unreported Compare results
    Test conditions
    Metric
    Score*
    Checkpoint version
    Not specified*
  • AndroidBench · version unreported · reported score · Public subset · avg@356.50*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Tasks
    95*
    Statistic
    avg@3*
    Task set
    Public subset*
  • Automation-Bench (Pass@1) · version unreported · reported score · Public subset14.20*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Tasks
    600*
    Task set
    Public subset*
  • CoWorkBench · version unreported · reported score · Internal64.60*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Task set
    Internal*
  • DeepSWE 1.1 · 1.1 · reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses21.60*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Claude Code or mini-SWE-agent; winning harness unspecified*
    Statistic
    Highest result across two harnesses*
    Temperature
    1.0*
    Top p
    0.95*
    Context length
    256K tokens*
  • FrontierSWE · version unreported · reported score · Not specified · Dominance recomputed from raw results40.70*Platform unreported Compare results
    Test conditions
    Metric
    Dominance score*
    Checkpoint version
    Not specified*
    Harness
    Not specified*
    Statistic
    Dominance recomputed from raw results*
    Evaluation date
    2026-08-03*
    Variant
    MEAN@5 submissions*
  • GPQA Diamond · version unreported · reported score92.40*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • HealthBench · version unreported · reported score54.50*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • HLE · version unreported · reported score · Disabled41.40*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Tool access
    Disabled*
  • HLE w/ tools · version unreported · reported score · Enabled53.50*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Tool access
    Enabled*
  • IFBench · version unreported · reported score79.10*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • JobBench · version unreported · reported score31.30*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • LongBench v2 · 2 · reported score65.30*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • MLS-Bench-Lite · version unreported · reported score · Not specified31.70*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Not specified*
  • MRCR v2 256K (8-needle) · 2 · reported score86.70*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Variant
    8-needle*
    Context length
    256K tokens*
  • NL2Repo-Bench · version unreported · reported score · Claude Code · Repository acquisition commands disabled47.20*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Claude Code*
    Tool access
    Repository acquisition commands disabled*
  • PaperBench · version unreported · reported score · BasicAgent64.80*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    BasicAgent*
    Variant
    Code-Dev*
    Judge
    Claude Opus 4.6*
    Runs
    3*
    Timeout
    12 hours per run*
  • PLawBench · version unreported · reported score58.90*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Judge
    gemini-3.1-pro-preview*
  • PRBench-Finance · version unreported · reported score46.80*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • PRBench-Legal · version unreported · reported score48.50*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • QwenQoderBench · version unreported · reported score · Claude Code · Internal · avg@536.80*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Claude Code*
    Statistic
    avg@5*
    Timeout
    6 hours*
    Task set
    Internal*
    Maximum output
    32,768*
    Temperature
    1.0*
    Context length
    256K tokens*
  • QwenReactBench · version unreported · reported score · Claude Code · Internal1,538* EloPlatform unreported Compare results
    Test conditions
    Metric
    BT/Elo rating*
    Checkpoint version
    Not specified*
    Languages
    English and Chinese*
    Judge
    Multimodal automatic judge*
    Task set
    Internal*
    Harness
    Claude Code*
  • QwenSVGBench · version unreported · reported score · Not specified · Internal1,499* EloPlatform unreported Compare results
    Test conditions
    Metric
    BT/Elo rating*
    Checkpoint version
    Not specified*
    Languages
    English and Chinese*
    Judge
    Multimodal automatic judge*
    Task set
    Internal*
    Harness
    Not specified*
  • QwenSWEBench · version unreported · reported score · Claude Code · Internal · avg@363.40*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Claude Code*
    Statistic
    avg@3*
    Timeout
    8 hours*
    Task set
    Internal*
    Maximum output
    32,768*
    Temperature
    1.0*
    Context length
    256K tokens*
  • SkillsBench · version unreported · reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task61.20*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    OpenCode*
    Tasks
    87*
    Statistic
    Average of three runs per task*
    Task set
    Public SkillsBench v1.1*
  • SWE-bench Pro · version unreported · reported score · Claude Code · Refined task set with corrected problematic tasks60.60*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Claude Code*
    Task set
    Refined task set with corrected problematic tasks*
    Temperature
    1.0*
    Top p
    0.95*
    Context length
    256K tokens*
  • Terminal Bench 2.1 · 2.1 · reported score · Harness not specified · Best published result across harnesses74.50*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Not specified*
    Statistic
    Best published result across harnesses*
  • Toolathlon Verified (Pass@1) · version unreported · reported score49.70*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
  • WideSearch · version unreported · reported score · Qwen-Agent · Average item F1 over four runs75.20*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*
    Harness
    Qwen-Agent*
    Statistic
    Average item F1 over four runs*
  • WorkSpaceBench · version unreported · reported score61.40*Platform unreported Compare results
    Test conditions
    Metric
    reported score*
    Checkpoint version
    Not specified*

Run it locally

Inference · memory estimate

Qwen3.7 Max

Closed weights. No supported local deployment or GPU requirement is published.

API cost

USD / month

Standard text-token estimate. Excludes taxes, caching, batch discounts, reasoning and multimodal surcharges. Provider limits and regional availability may differ.

Qwen3.7 Max

Qwen3.7 Max / Pricing tiers 1
Provider / scopeRateCurrencyAmount / unit
DeepInfraQwen/Qwen3.7-MaxStandard Cached inputUSD0.5 / 1M tokens
InputUSD2.5 / 1M tokens
OutputUSD7.5 / 1M tokens

Capabilities

Context window
1,000,000 tokens
Maximum output
131,072 tokens
Reasoning
Yes
Tool calling
Yes
Open weights
No

Input modalities

  • text

Output modalities

  • text

System configuration

Detailed specifications

Specifications · 32 fields
QwenSWEBench
suite
QwenSWEBench
workload
reported score · Claude Code · Internal · avg@3
score
63.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@3*
Timeout
8 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
QwenQoderBench
suite
QwenQoderBench
workload
reported score · Claude Code · Internal · avg@5
score
36.8*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@5*
Timeout
6 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
QwenReactBench
suite
QwenReactBench
workload
reported score · Claude Code · Internal
score
1,538.0*
unit
Elo
Scope and conditions
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Claude Code*
QwenSVGBench
suite
QwenSVGBench
workload
reported score · Not specified · Internal
score
1,499.0*
unit
Elo
Scope and conditions
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Not specified*
CoWorkBench
suite
CoWorkBench
workload
reported score · Internal
score
64.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Task set
Internal*
WorkSpaceBench
suite
WorkSpaceBench
workload
reported score
score
61.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
JobBench
suite
JobBench
workload
reported score
score
31.3*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SkillsBench
suite
SkillsBench
workload
reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task
score
61.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
OpenCode*
Tasks
87*
Statistic
Average of three runs per task*
Task set
Public SkillsBench v1.1*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Pass
score
11.8*
Scope and conditions
Test conditions
Metric
Pass*
Checkpoint version
Not specified*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Score
score
31.1*
Scope and conditions
Test conditions
Metric
Score*
Checkpoint version
Not specified*
Terminal Bench 2.1
suite
Terminal Bench 2.1
version
2.1
workload
reported score · Harness not specified · Best published result across harnesses
score
74.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Best published result across harnesses*
Automation-Bench (Pass@1)
suite
Automation-Bench (Pass@1)
workload
reported score · Public subset
score
14.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tasks
600*
Task set
Public subset*
Toolathlon Verified (Pass@1)
suite
Toolathlon Verified (Pass@1)
workload
reported score
score
49.7*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
WideSearch
suite
WideSearch
workload
reported score · Qwen-Agent · Average item F1 over four runs
score
75.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Qwen-Agent*
Statistic
Average item F1 over four runs*
HLE w/ tools
suite
HLE w/ tools
workload
reported score · Enabled
score
53.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Enabled*
GPQA Diamond
suite
GPQA Diamond
workload
reported score
score
92.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
HLE
suite
HLE
workload
reported score · Disabled
score
41.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Disabled*
IFBench
suite
IFBench
workload
reported score
score
79.1*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
$OneMillion-Bench (expert score)
suite
$OneMillion-Bench (expert score)
workload
reported score
score
44.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
HealthBench
suite
HealthBench
workload
reported score
score
54.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SWE-bench Pro
suite
SWE-bench Pro
workload
reported score · Claude Code · Refined task set with corrected problematic tasks
score
60.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Task set
Refined task set with corrected problematic tasks*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
PLawBench
suite
PLawBench
workload
reported score
score
58.9*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
PRBench-Legal
suite
PRBench-Legal
workload
reported score
score
48.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
PRBench-Finance
suite
PRBench-Finance
workload
reported score
score
46.8*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
MRCR v2 256K (8-needle)
suite
MRCR v2 256K (8-needle)
version
2
workload
reported score
score
86.7*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Variant
8-needle*
Context length
256K tokens*
LongBench v2
suite
LongBench v2
version
2
workload
reported score
score
65.3*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
DeepSWE 1.1
suite
DeepSWE 1.1
version
1.1
workload
reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses
score
21.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code or mini-SWE-agent; winning harness unspecified*
Statistic
Highest result across two harnesses*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
NL2Repo-Bench
suite
NL2Repo-Bench
workload
reported score · Claude Code · Repository acquisition commands disabled
score
47.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Tool access
Repository acquisition commands disabled*
FrontierSWE
suite
FrontierSWE
workload
reported score · Not specified · Dominance recomputed from raw results
score
40.7*
Scope and conditions
Test conditions
Metric
Dominance score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Dominance recomputed from raw results*
Evaluation date
2026-08-03*
Variant
MEAN@5 submissions*
MLS-Bench-Lite
suite
MLS-Bench-Lite
workload
reported score · Not specified
score
31.7*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
PaperBench
suite
PaperBench
workload
reported score · BasicAgent
score
64.8*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
BasicAgent*
Variant
Code-Dev*
Judge
Claude Opus 4.6*
Runs
3*
Timeout
12 hours per run*
AndroidBench
suite
AndroidBench
workload
reported score · Public subset · avg@3
score
56.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tasks
95*
Statistic
avg@3*
Task set
Public subset*

* Provisional data