DeepSWE 1.1 · 1.1 · reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses21.60*Platform unreported Compare resultsTest conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code or mini-SWE-agent; winning harness unspecified*
Statistic
Highest result across two harnesses*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
FrontierSWE · version unreported · reported score · Not specified · Dominance recomputed from raw results40.70*Platform unreported Compare resultsTest conditions
QwenQoderBench · version unreported · reported score · Claude Code · Internal · avg@536.80*Platform unreported Compare resultsTest conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@5*
Timeout
6 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
QwenReactBench · version unreported · reported score · Claude Code · Internal1,538* EloPlatform unreported Compare resultsTest conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Claude Code*
QwenSVGBench · version unreported · reported score · Not specified · Internal1,499* EloPlatform unreported Compare resultsTest conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Not specified*
QwenSWEBench · version unreported · reported score · Claude Code · Internal · avg@363.40*Platform unreported Compare resultsTest conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@3*
Timeout
8 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
SkillsBench · version unreported · reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task61.20*Platform unreported Compare resultsTest conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
OpenCode*
Tasks
87*
Statistic
Average of three runs per task*
Task set
Public SkillsBench v1.1*
SWE-bench Pro · version unreported · reported score · Claude Code · Refined task set with corrected problematic tasks60.60*Platform unreported Compare resultsTest conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Task set
Refined task set with corrected problematic tasks*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
Terminal Bench 2.1 · 2.1 · reported score · Harness not specified · Best published result across harnesses74.50*Platform unreported Compare resultsTest conditions
Closed weights. No supported local deployment or GPU requirement is published.
API cost
USD / month
Standard text-token estimate. Excludes taxes, caching, batch discounts, reasoning and multimodal surcharges. Provider limits and regional availability may differ.
Qwen3.7 Max
Qwen3.7 Max / Pricing tiers 1
Provider / scope
Rate
Currency
Amount / unit
DeepInfraQwen/Qwen3.7-MaxStandard
Cached input
USD
0.5 / 1M tokens
Input
USD
2.5 / 1M tokens
Output
USD
7.5 / 1M tokens
Capabilities
Context window
1,000,000 tokens
Maximum output
131,072 tokens
Reasoning
Yes
Tool calling
Yes
Open weights
No
Input modalities
text
Output modalities
text
System configuration
Detailed specifications
Specifications · 32 fields
QwenSWEBench
suite
QwenSWEBench
workload
reported score · Claude Code · Internal · avg@3
score
63.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@3*
Timeout
8 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
QwenQoderBench
suite
QwenQoderBench
workload
reported score · Claude Code · Internal · avg@5
score
36.8*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@5*
Timeout
6 hours*
Task set
Internal*
Maximum output
32,768*
Temperature
1.0*
Context length
256K tokens*
QwenReactBench
suite
QwenReactBench
workload
reported score · Claude Code · Internal
score
1,538.0*
unit
Elo
Scope and conditions
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Claude Code*
QwenSVGBench
suite
QwenSVGBench
workload
reported score · Not specified · Internal
score
1,499.0*
unit
Elo
Scope and conditions
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Not specified*
CoWorkBench
suite
CoWorkBench
workload
reported score · Internal
score
64.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Task set
Internal*
WorkSpaceBench
suite
WorkSpaceBench
workload
reported score
score
61.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
JobBench
suite
JobBench
workload
reported score
score
31.3*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SkillsBench
suite
SkillsBench
workload
reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task
score
61.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
OpenCode*
Tasks
87*
Statistic
Average of three runs per task*
Task set
Public SkillsBench v1.1*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Pass
score
11.8*
Scope and conditions
Test conditions
Metric
Pass*
Checkpoint version
Not specified*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Score
score
31.1*
Scope and conditions
Test conditions
Metric
Score*
Checkpoint version
Not specified*
Terminal Bench 2.1
suite
Terminal Bench 2.1
version
2.1
workload
reported score · Harness not specified · Best published result across harnesses
score
74.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Best published result across harnesses*
Automation-Bench (Pass@1)
suite
Automation-Bench (Pass@1)
workload
reported score · Public subset
score
14.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tasks
600*
Task set
Public subset*
Toolathlon Verified (Pass@1)
suite
Toolathlon Verified (Pass@1)
workload
reported score
score
49.7*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
WideSearch
suite
WideSearch
workload
reported score · Qwen-Agent · Average item F1 over four runs
score
75.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Qwen-Agent*
Statistic
Average item F1 over four runs*
HLE w/ tools
suite
HLE w/ tools
workload
reported score · Enabled
score
53.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Enabled*
GPQA Diamond
suite
GPQA Diamond
workload
reported score
score
92.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
HLE
suite
HLE
workload
reported score · Disabled
score
41.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Disabled*
IFBench
suite
IFBench
workload
reported score
score
79.1*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
$OneMillion-Bench (expert score)
suite
$OneMillion-Bench (expert score)
workload
reported score
score
44.4*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
HealthBench
suite
HealthBench
workload
reported score
score
54.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SWE-bench Pro
suite
SWE-bench Pro
workload
reported score · Claude Code · Refined task set with corrected problematic tasks
score
60.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Task set
Refined task set with corrected problematic tasks*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
PLawBench
suite
PLawBench
workload
reported score
score
58.9*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
PRBench-Legal
suite
PRBench-Legal
workload
reported score
score
48.5*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
PRBench-Finance
suite
PRBench-Finance
workload
reported score
score
46.8*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
MRCR v2 256K (8-needle)
suite
MRCR v2 256K (8-needle)
version
2
workload
reported score
score
86.7*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Variant
8-needle*
Context length
256K tokens*
LongBench v2
suite
LongBench v2
version
2
workload
reported score
score
65.3*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
DeepSWE 1.1
suite
DeepSWE 1.1
version
1.1
workload
reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses
score
21.6*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code or mini-SWE-agent; winning harness unspecified*
Statistic
Highest result across two harnesses*
Temperature
1.0*
Top p
0.95*
Context length
256K tokens*
NL2Repo-Bench
suite
NL2Repo-Bench
workload
reported score · Claude Code · Repository acquisition commands disabled
score
47.2*
Scope and conditions
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Tool access
Repository acquisition commands disabled*
FrontierSWE
suite
FrontierSWE
workload
reported score · Not specified · Dominance recomputed from raw results