GeekRadar / The comparison desk

COMPARE.

AI models

anthropic

Claude Haiku 3

AI model Released Mar 13, 2024

Context window: 200,000 tokens
Maximum output: 4,096 tokens
Open weights: No

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Claude Haiku 3 1194.6 claude-3-haiku-20240307 · 95% interval 1190.9–1198.4 · 117,701 votes · 2026-10-15

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-15 · rating

Claude Haiku 3

1,154.70 rating

Confidence interval: 1,145.78 – 1,163.63

16707 votes

Oct 15, 2026

Category: chinese
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-15 · rating

Claude Haiku 3

1,198.80 rating

Confidence interval: 1,191.96 – 1,205.63

20898 votes

Oct 15, 2026

Category: coding
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

Claude Haiku 3

1,157.18 rating

Confidence interval: 1,149.63 – 1,164.73

16718 votes

Oct 15, 2026

Category: creative_writing
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,206.02 rating

Confidence interval: 1,201.18 – 1,210.87

64537 votes

Oct 15, 2026

Category: english
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

Claude Haiku 3

1,075.07 rating

Confidence interval: 1,069.25 – 1,080.89

77578 votes

Oct 15, 2026

Category: exclude_ties
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-15 · rating

Claude Haiku 3

1,147.65 rating

Confidence interval: 1,136.85 – 1,158.44

6336 votes

Oct 15, 2026

Category: expert
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,194.77 rating

Confidence interval: 1,173.94 – 1,215.60

1772 votes

Oct 15, 2026

Category: french
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,173.65 rating

Confidence interval: 1,159.49 – 1,187.82

3508 votes

Oct 15, 2026

Category: german
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

Claude Haiku 3

1,173.81 rating

Confidence interval: 1,168.18 – 1,179.45

33698 votes

Oct 15, 2026

Category: hard_prompts
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,181.23 rating

Confidence interval: 1,174.55 – 1,187.90

20673 votes

Oct 15, 2026

Category: hard_prompts_english
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

Claude Haiku 3

1,157.56 rating

Confidence interval: 1,149.41 – 1,165.72

13237 votes

Oct 15, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

Claude Haiku 3

1,151.87 rating

Confidence interval: 1,144.65 – 1,159.09

17134 votes

Oct 15, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

Claude Haiku 3

1,191.03 rating

Confidence interval: 1,180.23 – 1,201.83

6799 votes

Oct 15, 2026

Category: industry_legal_and_government
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

Claude Haiku 3

1,178.31 rating

Confidence interval: 1,171.10 – 1,185.53

20565 votes

Oct 15, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,187.32 rating

Confidence interval: 1,179.52 – 1,195.13

13491 votes

Oct 15, 2026

Category: industry_mathematical
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

Claude Haiku 3

1,165.10 rating

Confidence interval: 1,153.94 – 1,176.26

6385 votes

Oct 15, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

Claude Haiku 3

1,193.94 rating

Confidence interval: 1,188.03 – 1,199.85

34258 votes

Oct 15, 2026

Category: industry_software_and_it_services
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

Claude Haiku 3

1,193.91 rating

Confidence interval: 1,187.66 – 1,200.16

29876 votes

Oct 15, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

Claude Haiku 3

1,173.19 rating

Confidence interval: 1,167.91 – 1,178.47

43031 votes

Oct 15, 2026

Category: instruction_following
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-15 · rating

Claude Haiku 3

1,102.32 rating

Confidence interval: 1,085.45 – 1,119.19

2063 votes

Oct 15, 2026

Category: japanese
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,108.53 rating

Confidence interval: 1,089.77 – 1,127.29

2364 votes

Oct 15, 2026

Category: korean
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,190.12 rating

Confidence interval: 1,182.50 – 1,197.74

13976 votes

Oct 15, 2026

Category: longer_query
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,188.01 rating

Confidence interval: 1,180.59 – 1,195.42

14983 votes

Oct 15, 2026

Category: math
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,189.91 rating

Confidence interval: 1,182.69 – 1,197.14

19344 votes

Oct 15, 2026

Category: multi_turn
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,177.54 rating

Confidence interval: 1,172.51 – 1,182.57

53164 votes

Oct 15, 2026

Category: non_english
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,194.64 rating

Confidence interval: 1,190.91 – 1,198.38

117701 votes

Oct 15, 2026

Category: overall
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / polishhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,233.50 rating

Confidence interval: 1,182.01 – 1,284.99

264 votes

Oct 15, 2026

Category: polish
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,204.16 rating

Confidence interval: 1,196.00 – 1,212.31

11956 votes

Oct 15, 2026

Category: russian
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-15 · rating

Claude Haiku 3

1,165.48 rating

Confidence interval: 1,144.84 – 1,186.11

1704 votes

Oct 15, 2026

Category: spanish
Evaluated configuration: claude-3-haiku-20240307
Evaluation type: human preference

Run it locally

Inference · memory estimate

Claude Haiku 3

Closed weights. No supported local deployment or GPU requirement is published.

API cost

USD / month

Input tokens / monthOutput tokens / month

Standard text-token estimate. Excludes taxes, caching, batch discounts, reasoning and multimodal surcharges. Provider limits and regional availability may differ.

Claude Haiku 3

Provider offer

Capabilities

Context window: 200,000 tokens
Maximum output: 4,096 tokens
Reasoning: No
Tool calling: Yes
Open weights: No
Knowledge cutoff: 2023-08-31
Model license: Proprietary

Input modalities

text
image
pdf

Output modalities

text