GeekRadar / The comparison desk
COMPARE.
AI models
Not reported

Gemma 2 9B IT SimPO

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Gemma 2 9B IT SimPO 1227.0 Gemma 2 9B IT SimPO · 95% interval 1220.2–1233.9 · 10,072 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,225.05 rating

Confidence interval: 1,204.21 – 1,245.90

753 votes

Category
chinese
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,190.60 rating

Confidence interval: 1,175.85 – 1,205.36

1471 votes

Category
coding
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,238.48 rating

Confidence interval: 1,223.95 – 1,253.01

1671 votes

Category
creative_writing
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,242.38 rating

Confidence interval: 1,233.71 – 1,251.05

5834 votes

Category
english
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,122.31 rating

Confidence interval: 1,111.64 – 1,132.99

6321 votes

Category
exclude_ties
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,154.27 rating

Confidence interval: 1,124.91 – 1,183.62

369 votes

Category
expert
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,218.44 rating

Confidence interval: 1,187.26 – 1,249.61

318 votes

Category
german
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,195.99 rating

Confidence interval: 1,184.69 – 1,207.29

2554 votes

Category
hard_prompts
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,201.06 rating

Confidence interval: 1,187.34 – 1,214.79

1661 votes

Category
hard_prompts_english
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,222.23 rating

Confidence interval: 1,205.08 – 1,239.39

1121 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,214.61 rating

Confidence interval: 1,200.58 – 1,228.63

1692 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,268.49 rating

Confidence interval: 1,244.06 – 1,292.92

543 votes

Category
industry_legal_and_government
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,230.88 rating

Confidence interval: 1,216.09 – 1,245.66

1596 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,195.89 rating

Confidence interval: 1,180.15 – 1,211.64

1139 votes

Category
industry_mathematical
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,221.53 rating

Confidence interval: 1,195.57 – 1,247.49

516 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,211.33 rating

Confidence interval: 1,199.46 – 1,223.20

2537 votes

Category
industry_software_and_it_services
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,225.82 rating

Confidence interval: 1,214.20 – 1,237.44

2801 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,190.90 rating

Confidence interval: 1,180.96 – 1,200.84

3741 votes

Category
instruction_following
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,139.78 rating

Confidence interval: 1,107.38 – 1,172.19

291 votes

Category
japanese
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,225.93 rating

Confidence interval: 1,207.05 – 1,244.81

841 votes

Category
longer_query
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,172.71 rating

Confidence interval: 1,157.61 – 1,187.81

1285 votes

Category
math
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,219.66 rating

Confidence interval: 1,205.22 – 1,234.11

1660 votes

Category
multi_turn
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,206.19 rating

Confidence interval: 1,196.58 – 1,215.81

4238 votes

Category
non_english
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,227.04 rating

Confidence interval: 1,220.20 – 1,233.88

10072 votes

Category
overall
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-28 · rating

Gemma 2 9B IT SimPO

1,224.36 rating

Confidence interval: 1,207.50 – 1,241.23

1119 votes

Category
russian
Evaluated configuration
Gemma 2 9B IT SimPO
Evaluation type
human preference

Run it locally

Inference · memory estimate

Gemma 2 9B IT SimPO

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
MIT