GeekRadar / The comparison desk
COMPARE.
AI models
anthropic

claude-3-5-sonnet-20240620

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

claude-3-5-sonnet-20240620 1280.9 claude-3-5-sonnet-20240620 · 95% interval 1277.5–1284.3 · 82,419 votes · 2026-10-15

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,264.69 rating

Confidence interval: 1,255.36 – 1,274.01

8100 votes

Category
chinese
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,306.33 rating

Confidence interval: 1,299.34 – 1,313.32

13607 votes

Category
coding
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,237.95 rating

Confidence interval: 1,230.32 – 1,245.58

12430 votes

Category
creative_writing
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,287.25 rating

Confidence interval: 1,282.77 – 1,291.74

44433 votes

Category
english
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,205.78 rating

Confidence interval: 1,200.61 – 1,210.96

55109 votes

Category
exclude_ties
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,246.69 rating

Confidence interval: 1,235.63 – 1,257.76

4314 votes

Category
expert
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,293.67 rating

Confidence interval: 1,270.13 – 1,317.21

936 votes

Category
french
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,270.80 rating

Confidence interval: 1,256.04 – 1,285.56

2499 votes

Category
german
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,275.25 rating

Confidence interval: 1,269.69 – 1,280.82

23249 votes

Category
hard_prompts
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,282.25 rating

Confidence interval: 1,275.44 – 1,289.06

14269 votes

Category
hard_prompts_english
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,234.82 rating

Confidence interval: 1,226.64 – 1,243.00

9702 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,238.57 rating

Confidence interval: 1,231.32 – 1,245.82

13185 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,265.47 rating

Confidence interval: 1,254.54 – 1,276.40

4818 votes

Category
industry_legal_and_government
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,269.83 rating

Confidence interval: 1,262.64 – 1,277.02

13749 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,293.52 rating

Confidence interval: 1,285.72 – 1,301.32

10038 votes

Category
industry_mathematical
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,244.62 rating

Confidence interval: 1,233.19 – 1,256.05

4460 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,288.33 rating

Confidence interval: 1,282.47 – 1,294.20

22198 votes

Category
industry_software_and_it_services
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,280.04 rating

Confidence interval: 1,273.95 – 1,286.14

21916 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,269.45 rating

Confidence interval: 1,264.36 – 1,274.54

32074 votes

Category
instruction_following
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,230.78 rating

Confidence interval: 1,214.61 – 1,246.95

2127 votes

Category
japanese
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,200.34 rating

Confidence interval: 1,180.88 – 1,219.80

1715 votes

Category
korean
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,274.73 rating

Confidence interval: 1,267.05 – 1,282.41

10574 votes

Category
longer_query
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,303.28 rating

Confidence interval: 1,295.83 – 1,310.73

11359 votes

Category
math
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,299.19 rating

Confidence interval: 1,292.05 – 1,306.34

14950 votes

Category
multi_turn
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,270.00 rating

Confidence interval: 1,265.26 – 1,274.75

37986 votes

Category
non_english
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,280.88 rating

Confidence interval: 1,277.46 – 1,284.30

82419 votes

Category
overall
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / polishhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,328.51 rating

Confidence interval: 1,260.26 – 1,396.76

97 votes

Category
polish
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,282.46 rating

Confidence interval: 1,274.44 – 1,290.49

9966 votes

Category
russian
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-10-15 · rating

claude-3-5-sonnet-20240620

1,289.47 rating

Confidence interval: 1,267.08 – 1,311.85

1123 votes

Category
spanish
Evaluated configuration
claude-3-5-sonnet-20240620
Evaluation type
human preference

Run it locally

Inference · memory estimate

claude-3-5-sonnet-20240620

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Proprietary