Radar task score: four tests, equal weight. An experimental summary of these tasks, not a universal intelligence rating.
Claude Opus 4.1
Radar task score
/ 100
1/4 core tests · not enough evidence
1 benchmark results for this configuration
Scientific reasoning
GPQA Diamond · 25%
Expert-written science questions; strict multiple-choice scoring. Chance accuracy is 25%.
050100%
Claude Opus 4.1Not available
Novel problem solving
Mystery Game Puzzles · 25%
Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.
050100%
Claude Opus 4.121.0*%Approx. 95% interval: 13.0–29.0%
Advanced mathematics
FrontierMath Tiers 1-3 · 25%
Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.
050100%
Claude Opus 4.1Not available
Factual answers
SimpleQA Verified · 25%
Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.
050100%
Claude Opus 4.1Not available
Research mathematics
FrontierMath Tier 4 v2 · Separate result
The hardest private FrontierMath problems, corrected v2 set, with Python tools. Separate from Tiers 1-3 in the core score.
050100%
Claude Opus 4.1Not available
Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
Arena text preference / chinesehuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,427.04 rating
Confidence interval: 1,418.97 – 1,435.11
5945 votes
Category
chinese
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,425.38 rating
Confidence interval: 1,415.60 – 1,435.15
3875 votes
Category
chinese
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,478.74 rating
Confidence interval: 1,472.31 – 1,485.17
9919 votes
Category
coding
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,472.72 rating
Confidence interval: 1,467.38 – 1,478.07
15695 votes
Category
coding
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,411.87 rating
Confidence interval: 1,404.22 – 1,419.51
6868 votes
Category
creative_writing
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,410.48 rating
Confidence interval: 1,404.26 – 1,416.69
10875 votes
Category
creative_writing
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,432.63 rating
Confidence interval: 1,427.85 – 1,437.41
20907 votes
Category
english
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,426.48 rating
Confidence interval: 1,422.38 – 1,430.59
32163 votes
Category
english
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,406.99 rating
Confidence interval: 1,402.27 – 1,411.71
35616 votes
Category
exclude_ties
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,405.54 rating
Confidence interval: 1,401.48 – 1,409.60
55572 votes
Category
exclude_ties
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,438.37 rating
Confidence interval: 1,426.60 – 1,450.14
2539 votes
Category
expert
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,425.43 rating
Confidence interval: 1,416.19 – 1,434.67
4229 votes
Category
expert
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,431.73 rating
Confidence interval: 1,410.65 – 1,452.81
853 votes
Category
french
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,427.45 rating
Confidence interval: 1,410.82 – 1,444.08
1416 votes
Category
french
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,412.56 rating
Confidence interval: 1,393.84 – 1,431.29
1049 votes
Category
german
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,404.86 rating
Confidence interval: 1,389.39 – 1,420.32
1567 votes
Category
german
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,442.33 rating
Confidence interval: 1,437.80 – 1,446.87
24954 votes
Category
hard_prompts
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,442.14 rating
Confidence interval: 1,438.28 – 1,446.01
39442 votes
Category
hard_prompts
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,450.98 rating
Confidence interval: 1,444.83 – 1,457.13
10730 votes
Category
hard_prompts_english
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,447.84 rating
Confidence interval: 1,442.60 – 1,453.07
16447 votes
Category
hard_prompts_english
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,398.42 rating
Confidence interval: 1,392.88 – 1,403.95
14236 votes
Category
industry_entertainment_and_sports_and_media
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,396.60 rating
Confidence interval: 1,390.00 – 1,403.21
9090 votes
Category
industry_entertainment_and_sports_and_media
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,420.42 rating
Confidence interval: 1,409.95 – 1,430.89
3214 votes
Category
industry_legal_and_government
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,417.42 rating
Confidence interval: 1,409.01 – 1,425.82
5338 votes
Category
industry_legal_and_government
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,421.97 rating
Confidence interval: 1,414.97 – 1,428.98
7937 votes
Category
industry_life_and_physical_and_social_science
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,416.90 rating
Confidence interval: 1,411.06 – 1,422.74
12270 votes
Category
industry_life_and_physical_and_social_science
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,433.76 rating
Confidence interval: 1,422.20 – 1,445.33
2485 votes
Category
industry_mathematical
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,425.79 rating
Confidence interval: 1,416.41 – 1,435.16
3909 votes
Category
industry_mathematical
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,415.60 rating
Confidence interval: 1,404.06 – 1,427.14
2705 votes
Category
industry_medicine_and_healthcare
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,412.92 rating
Confidence interval: 1,403.57 – 1,422.27
4432 votes
Category
industry_medicine_and_healthcare
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,456.32 rating
Confidence interval: 1,451.09 – 1,461.54
16728 votes
Category
industry_software_and_it_services
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,451.62 rating
Confidence interval: 1,447.18 – 1,456.07
26055 votes
Category
industry_software_and_it_services
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,418.05 rating
Confidence interval: 1,412.89 – 1,423.21
17469 votes
Category
industry_writing_and_literature_and_language
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,417.89 rating
Confidence interval: 1,411.70 – 1,424.08
11060 votes
Category
industry_writing_and_literature_and_language
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,435.37 rating
Confidence interval: 1,429.64 – 1,441.10
13208 votes
Category
instruction_following
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,433.63 rating
Confidence interval: 1,428.80 – 1,438.45
20779 votes
Category
instruction_following
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,377.49 rating
Confidence interval: 1,355.06 – 1,399.91
674 votes
Category
japanese
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,374.36 rating
Confidence interval: 1,356.61 – 1,392.11
1198 votes
Category
japanese
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,380.43 rating
Confidence interval: 1,361.82 – 1,399.04
1103 votes
Category
korean
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,364.08 rating
Confidence interval: 1,348.51 – 1,379.66
1613 votes
Category
korean
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,454.81 rating
Confidence interval: 1,448.75 – 1,460.86
11485 votes
Category
longer_query
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,444.18 rating
Confidence interval: 1,439.13 – 1,449.23
18482 votes
Category
longer_query
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,430.97 rating
Confidence interval: 1,420.48 – 1,441.46
3059 votes
Category
math
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,421.79 rating
Confidence interval: 1,413.30 – 1,430.27
4806 votes
Category
math
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,444.10 rating
Confidence interval: 1,437.27 – 1,450.94
8468 votes
Category
multi_turn
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,443.15 rating
Confidence interval: 1,437.36 – 1,448.94
13115 votes
Category
multi_turn
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,405.56 rating
Confidence interval: 1,401.88 – 1,409.24
45037 votes
Category
non_english
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,403.70 rating
Confidence interval: 1,399.40 – 1,408.00
28591 votes
Category
non_english
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,419.20 rating
Confidence interval: 1,415.74 – 1,422.66
49542 votes
Category
overall
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
1,418.65 rating
Confidence interval: 1,415.67 – 1,421.62
77238 votes
Category
overall
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
Arena text preference / polishhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,413.00 rating
Confidence interval: 1,402.79 – 1,423.22
3733 votes
Category
polish
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,408.25 rating
Confidence interval: 1,395.78 – 1,420.72
2408 votes
Category
polish
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,421.82 rating
Confidence interval: 1,414.70 – 1,428.95
7233 votes
Category
russian
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,416.74 rating
Confidence interval: 1,407.76 – 1,425.72
4220 votes
Category
russian
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-10-15 · rating
Claude Opus 4.1
1,448.24 rating
Confidence interval: 1,434.93 – 1,461.55
2301 votes
Category
spanish
Evaluated configuration
claude-opus-4-1-20250805
Evaluation type
human preference
1,445.35 rating
Confidence interval: 1,428.03 – 1,462.66
1294 votes
Category
spanish
Evaluated configuration
claude-opus-4-1-20250805-thinking-16k
Evaluation type
human preference
Run it locally
Inference · memory estimate
Claude Opus 4.1
Closed weights. No supported local deployment or GPU requirement is published.
API cost
USD / month
Standard text-token estimate. Excludes taxes, caching, batch discounts, reasoning and multimodal surcharges. Provider limits and regional availability may differ.
Claude Opus 4.1
Claude Opus 4.1 / Pricing tiers 1
Provider / scope
Rate
Currency
Amount / unit
AWS BedrockClaude Opus 4.1StandardGlobal cross-region