$OneMillion-Bench (expert score) · versione non riportata · reported score44,40*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
Agents' Last Exam (Pass / Score) · versione non riportata · Pass11,80*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
Pass*
Checkpoint version
Not specified*
Agents' Last Exam (Pass / Score) · versione non riportata · Score31,10*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
Score*
Checkpoint version
Not specified*
AndroidBench · versione non riportata · reported score · Public subset · avg@356,50*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Tasks
95*
Statistic
avg@3*
Task set
Public subset*
Automation-Bench (Pass@1) · versione non riportata · reported score · Public subset14,20*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Tasks
600*
Task set
Public subset*
CoWorkBench · versione non riportata · reported score · Internal64,60*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Task set
Internal*
DeepSWE 1.1 · 1.1 · reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses21,60*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code or mini-SWE-agent; winning harness unspecified*
Statistic
Highest result across two harnesses*
Temperature
1,0*
Top p
0,95*
Context length
256K tokens*
FrontierSWE · versione non riportata · reported score · Not specified · Dominance recomputed from raw results40,70*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
Dominance score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Dominance recomputed from raw results*
Evaluation date
2026-08-03*
Variant
MEAN@5 submissions*
GPQA Diamond · versione non riportata · reported score92,40*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
HealthBench · versione non riportata · reported score54,50*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
HLE · versione non riportata · reported score · Disabled41,40*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Disabled*
HLE w/ tools · versione non riportata · reported score · Enabled53,50*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Enabled*
IFBench · versione non riportata · reported score79,10*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
JobBench · versione non riportata · reported score31,30*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
LongBench v2 · 2 · reported score65,30*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
MLS-Bench-Lite · versione non riportata · reported score · Not specified31,70*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
MRCR v2 256K (8-needle) · 2 · reported score86,70*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Variant
8-needle*
Context length
256K tokens*
NL2Repo-Bench · versione non riportata · reported score · Claude Code · Repository acquisition commands disabled47,20*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Tool access
Repository acquisition commands disabled*
PaperBench · versione non riportata · reported score · BasicAgent64,80*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
BasicAgent*
Variant
Code-Dev*
Judge
Claude Opus 4.6*
Runs
3*
Timeout
12 hours per run*
PLawBench · versione non riportata · reported score58,90*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
PRBench-Finance · versione non riportata · reported score46,80*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
PRBench-Legal · versione non riportata · reported score48,50*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
QwenQoderBench · versione non riportata · reported score · Claude Code · Internal · avg@536,80*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@5*
Timeout
6 hours*
Task set
Internal*
Maximum output
32.768*
Temperature
1,0*
Context length
256K tokens*
QwenReactBench · versione non riportata · reported score · Claude Code · Internal1.538* EloPiattaforma non riportata Confronta i risultatiCondizioni di test
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Claude Code*
QwenSVGBench · versione non riportata · reported score · Not specified · Internal1.499* EloPiattaforma non riportata Confronta i risultatiCondizioni di test
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Not specified*
QwenSWEBench · versione non riportata · reported score · Claude Code · Internal · avg@363,40*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@3*
Timeout
8 hours*
Task set
Internal*
Maximum output
32.768*
Temperature
1,0*
Context length
256K tokens*
SkillsBench · versione non riportata · reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task61,20*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
OpenCode*
Tasks
87*
Statistic
Average of three runs per task*
Task set
Public SkillsBench v1.1*
SWE-bench Pro · versione non riportata · reported score · Claude Code · Refined task set with corrected problematic tasks60,60*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Task set
Refined task set with corrected problematic tasks*
Temperature
1,0*
Top p
0,95*
Context length
256K tokens*
Terminal Bench 2.1 · 2.1 · reported score · Harness not specified · Best published result across harnesses74,50*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Best published result across harnesses*
Toolathlon Verified (Pass@1) · versione non riportata · reported score49,70*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
WideSearch · versione non riportata · reported score · Qwen-Agent · Average item F1 over four runs75,20*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Harness
Qwen-Agent*
Statistic
Average item F1 over four runs*
WorkSpaceBench · versione non riportata · reported score61,40*Piattaforma non riportata Confronta i risultatiCondizioni di test
Metric
reported score*
Checkpoint version
Not specified*
Esecuzione locale
Inferenza · stima della memoria
Qwen3.7 Max
Pesi chiusi. Non sono pubblicati un impiego locale supportato o requisiti GPU.
Costo API
USD / mese
Stima per token di testo standard. Esclude imposte, cache, sconti batch e costi aggiuntivi per ragionamento e modalità multimediali. Limiti e disponibilità possono variare per provider.
Qwen3.7 Max
Qwen3.7 Max / Fasce di prezzo 1
Provider / condizioni
Tariffa
Valuta
Importo / unità
DeepInfraQwen/Qwen3.7-MaxStandard
Input in cache
USD
0.5 / 1M tokens
Input
USD
2.5 / 1M tokens
Output
USD
7.5 / 1M tokens
Capacità
Finestra di contesto
1.000.000 tokens
Output massimo
131.072 tokens
Ragionamento
Sì
Uso di strumenti
Sì
Pesi aperti
No
Modalità di input
text
Modalità di output
text
Configurazione di sistema
Specifiche dettagliate
Specifiche · 32 campi
QwenSWEBench
suite
QwenSWEBench
workload
reported score · Claude Code · Internal · avg@3
score
63,4*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@3*
Timeout
8 hours*
Task set
Internal*
Maximum output
32.768*
Temperature
1,0*
Context length
256K tokens*
QwenQoderBench
suite
QwenQoderBench
workload
reported score · Claude Code · Internal · avg@5
score
36,8*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Statistic
avg@5*
Timeout
6 hours*
Task set
Internal*
Maximum output
32.768*
Temperature
1,0*
Context length
256K tokens*
QwenReactBench
suite
QwenReactBench
workload
reported score · Claude Code · Internal
score
1.538,0*
unit
Elo
Ambito e condizioni
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Claude Code*
QwenSVGBench
suite
QwenSVGBench
workload
reported score · Not specified · Internal
score
1.499,0*
unit
Elo
Ambito e condizioni
Test conditions
Metric
BT/Elo rating*
Checkpoint version
Not specified*
Languages
English and Chinese*
Judge
Multimodal automatic judge*
Task set
Internal*
Harness
Not specified*
CoWorkBench
suite
CoWorkBench
workload
reported score · Internal
score
64,6*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Task set
Internal*
WorkSpaceBench
suite
WorkSpaceBench
workload
reported score
score
61,4*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
JobBench
suite
JobBench
workload
reported score
score
31,3*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SkillsBench
suite
SkillsBench
workload
reported score · OpenCode · Public SkillsBench v1.1 · Average of three runs per task
score
61,2*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
OpenCode*
Tasks
87*
Statistic
Average of three runs per task*
Task set
Public SkillsBench v1.1*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Pass
score
11,8*
Ambito e condizioni
Test conditions
Metric
Pass*
Checkpoint version
Not specified*
Agents' Last Exam (Pass / Score)
suite
Agents' Last Exam (Pass / Score)
workload
Score
score
31,1*
Ambito e condizioni
Test conditions
Metric
Score*
Checkpoint version
Not specified*
Terminal Bench 2.1
suite
Terminal Bench 2.1
version
2.1
workload
reported score · Harness not specified · Best published result across harnesses
score
74,5*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Not specified*
Statistic
Best published result across harnesses*
Automation-Bench (Pass@1)
suite
Automation-Bench (Pass@1)
workload
reported score · Public subset
score
14,2*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tasks
600*
Task set
Public subset*
Toolathlon Verified (Pass@1)
suite
Toolathlon Verified (Pass@1)
workload
reported score
score
49,7*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
WideSearch
suite
WideSearch
workload
reported score · Qwen-Agent · Average item F1 over four runs
score
75,2*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Qwen-Agent*
Statistic
Average item F1 over four runs*
HLE w/ tools
suite
HLE w/ tools
workload
reported score · Enabled
score
53,5*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Enabled*
GPQA Diamond
suite
GPQA Diamond
workload
reported score
score
92,4*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
HLE
suite
HLE
workload
reported score · Disabled
score
41,4*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Tool access
Disabled*
IFBench
suite
IFBench
workload
reported score
score
79,1*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
$OneMillion-Bench (expert score)
suite
$OneMillion-Bench (expert score)
workload
reported score
score
44,4*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
HealthBench
suite
HealthBench
workload
reported score
score
54,5*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
SWE-bench Pro
suite
SWE-bench Pro
workload
reported score · Claude Code · Refined task set with corrected problematic tasks
score
60,6*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Task set
Refined task set with corrected problematic tasks*
Temperature
1,0*
Top p
0,95*
Context length
256K tokens*
PLawBench
suite
PLawBench
workload
reported score
score
58,9*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Judge
gemini-3.1-pro-preview*
PRBench-Legal
suite
PRBench-Legal
workload
reported score
score
48,5*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
PRBench-Finance
suite
PRBench-Finance
workload
reported score
score
46,8*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
MRCR v2 256K (8-needle)
suite
MRCR v2 256K (8-needle)
version
2
workload
reported score
score
86,7*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Variant
8-needle*
Context length
256K tokens*
LongBench v2
suite
LongBench v2
version
2
workload
reported score
score
65,3*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
DeepSWE 1.1
suite
DeepSWE 1.1
version
1.1
workload
reported score · Claude Code or mini-SWE-agent; winning harness unspecified · Highest result across two harnesses
score
21,6*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code or mini-SWE-agent; winning harness unspecified*
Statistic
Highest result across two harnesses*
Temperature
1,0*
Top p
0,95*
Context length
256K tokens*
NL2Repo-Bench
suite
NL2Repo-Bench
workload
reported score · Claude Code · Repository acquisition commands disabled
score
47,2*
Ambito e condizioni
Test conditions
Metric
reported score*
Checkpoint version
Not specified*
Harness
Claude Code*
Tool access
Repository acquisition commands disabled*
FrontierSWE
suite
FrontierSWE
workload
reported score · Not specified · Dominance recomputed from raw results