GeekRadar / The comparison desk
COMPARE.
AI models
mistral

Mistral Small 24B Instruct (2501)

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Mistral Small 24B Instruct (2501) 1233.5 Mistral Small 24B Instruct (2501) · 95% interval 1227.7–1239.4 · 14,681 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,203.60 rating

Confidence interval: 1,185.95 – 1,221.25

1054 votes

Category
chinese
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,245.45 rating

Confidence interval: 1,232.99 – 1,257.91

2083 votes

Category
coding
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,194.37 rating

Confidence interval: 1,182.27 – 1,206.47

2415 votes

Category
creative_writing
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,256.13 rating

Confidence interval: 1,249.09 – 1,263.16

8740 votes

Category
english
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,128.99 rating

Confidence interval: 1,119.76 – 1,138.22

9628 votes

Category
exclude_ties
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,201.56 rating

Confidence interval: 1,181.05 – 1,222.08

754 votes

Category
expert
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,203.64 rating

Confidence interval: 1,154.31 – 1,252.97

142 votes

Category
french
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,211.35 rating

Confidence interval: 1,177.89 – 1,244.81

301 votes

Category
german
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,232.96 rating

Confidence interval: 1,223.40 – 1,242.53

3569 votes

Category
hard_prompts
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,243.08 rating

Confidence interval: 1,231.34 – 1,254.82

2355 votes

Category
hard_prompts_english
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,205.33 rating

Confidence interval: 1,189.73 – 1,220.93

1443 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,183.77 rating

Confidence interval: 1,172.36 – 1,195.18

2680 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,218.96 rating

Confidence interval: 1,198.30 – 1,239.62

869 votes

Category
industry_legal_and_government
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,234.84 rating

Confidence interval: 1,223.10 – 1,246.59

2579 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,243.16 rating

Confidence interval: 1,228.75 – 1,257.58

1447 votes

Category
industry_mathematical
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,215.36 rating

Confidence interval: 1,191.64 – 1,239.09

654 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,248.02 rating

Confidence interval: 1,238.11 – 1,257.93

3478 votes

Category
industry_software_and_it_services
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,213.87 rating

Confidence interval: 1,204.43 – 1,223.30

3942 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,213.81 rating

Confidence interval: 1,205.67 – 1,221.95

5485 votes

Category
instruction_following
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,110.98 rating

Confidence interval: 1,074.80 – 1,147.15

269 votes

Category
japanese
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,188.13 rating

Confidence interval: 1,148.53 – 1,227.74

231 votes

Category
korean
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,245.57 rating

Confidence interval: 1,232.11 – 1,259.04

1767 votes

Category
longer_query
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,240.22 rating

Confidence interval: 1,226.86 – 1,253.58

1683 votes

Category
math
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,216.60 rating

Confidence interval: 1,203.70 – 1,229.49

2151 votes

Category
multi_turn
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,198.04 rating

Confidence interval: 1,190.13 – 1,205.94

5941 votes

Category
non_english
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,233.54 rating

Confidence interval: 1,227.66 – 1,239.41

14681 votes

Category
overall
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-28 · rating

Mistral Small 24B Instruct (2501)

1,215.84 rating

Confidence interval: 1,201.19 – 1,230.50

1418 votes

Category
russian
Evaluated configuration
Mistral Small 24B Instruct (2501)
Evaluation type
human preference

Run it locally

Inference · memory estimate

Mistral Small 24B Instruct (2501)

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Apache 2.0