GeekRadar / The comparison desk
COMPARE.
AI models
allenai

OLMo-7B-Instruct

AI model

Context window
2,048 tokens
Open weights
Yes

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

OLMo-7B-Instruct 1031.8 OLMo 7B Instruct · 95% interval 1020.8–1042.8 · 6,328 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,013.54 rating

Confidence interval: 990.30 – 1,036.77

722 votes

Category
chinese
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,015.39 rating

Confidence interval: 993.76 – 1,037.01

772 votes

Category
coding
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

989.43 rating

Confidence interval: 969.31 – 1,009.55

1019 votes

Category
creative_writing
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,066.72 rating

Confidence interval: 1,053.82 – 1,079.63

4043 votes

Category
english
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

827.18 rating

Confidence interval: 809.97 – 844.40

4315 votes

Category
exclude_ties
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

992.68 rating

Confidence interval: 976.04 – 1,009.33

1462 votes

Category
hard_prompts
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,009.88 rating

Confidence interval: 991.26 – 1,028.51

1076 votes

Category
hard_prompts_english
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,019.56 rating

Confidence interval: 993.65 – 1,045.48

548 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

990.77 rating

Confidence interval: 970.19 – 1,011.34

876 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,046.76 rating

Confidence interval: 1,012.12 – 1,081.39

301 votes

Category
industry_legal_and_government
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,007.87 rating

Confidence interval: 988.11 – 1,027.62

1169 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,018.04 rating

Confidence interval: 997.62 – 1,038.47

726 votes

Category
industry_mathematical
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,034.69 rating

Confidence interval: 1,002.48 – 1,066.90

339 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,037.06 rating

Confidence interval: 1,019.79 – 1,054.33

1474 votes

Category
industry_software_and_it_services
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,003.07 rating

Confidence interval: 985.26 – 1,020.88

1511 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

978.10 rating

Confidence interval: 962.43 – 993.77

1908 votes

Category
instruction_following
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,017.75 rating

Confidence interval: 998.77 – 1,036.73

848 votes

Category
math
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,007.02 rating

Confidence interval: 979.50 – 1,034.53

537 votes

Category
multi_turn
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

977.18 rating

Confidence interval: 961.88 – 992.48

2285 votes

Category
non_english
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

1,031.78 rating

Confidence interval: 1,020.76 – 1,042.81

6328 votes

Category
overall
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-28 · rating

OLMo-7B-Instruct

946.26 rating

Confidence interval: 918.41 – 974.11

497 votes

Category
russian
Evaluated configuration
OLMo 7B Instruct
Evaluation type
human preference
Arena text preference / chinesehuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,013.58 rating

Confidence interval: 990.35 – 1,036.82

722 votes

Category
chinese
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,015.49 rating

Confidence interval: 993.85 – 1,037.12

772 votes

Category
coding
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

989.58 rating

Confidence interval: 969.46 – 1,009.71

1019 votes

Category
creative_writing
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,066.67 rating

Confidence interval: 1,053.76 – 1,079.58

4043 votes

Category
english
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

827.19 rating

Confidence interval: 809.98 – 844.41

4315 votes

Category
exclude_ties
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

992.67 rating

Confidence interval: 976.03 – 1,009.32

1462 votes

Category
hard_prompts
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,009.77 rating

Confidence interval: 991.14 – 1,028.40

1076 votes

Category
hard_prompts_english
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,019.60 rating

Confidence interval: 993.68 – 1,045.53

548 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

990.83 rating

Confidence interval: 970.24 – 1,011.41

876 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,046.50 rating

Confidence interval: 1,011.86 – 1,081.15

301 votes

Category
industry_legal_and_government
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,007.85 rating

Confidence interval: 988.09 – 1,027.61

1169 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,018.04 rating

Confidence interval: 997.61 – 1,038.46

726 votes

Category
industry_mathematical
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,034.75 rating

Confidence interval: 1,002.53 – 1,066.97

339 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,037.14 rating

Confidence interval: 1,019.87 – 1,054.42

1474 votes

Category
industry_software_and_it_services
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,003.13 rating

Confidence interval: 985.32 – 1,020.94

1511 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

978.11 rating

Confidence interval: 962.44 – 993.78

1908 votes

Category
instruction_following
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,017.71 rating

Confidence interval: 998.73 – 1,036.69

848 votes

Category
math
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,007.01 rating

Confidence interval: 979.49 – 1,034.54

537 votes

Category
multi_turn
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

977.28 rating

Confidence interval: 961.97 – 992.58

2285 votes

Category
non_english
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

1,031.77 rating

Confidence interval: 1,020.74 – 1,042.80

6328 votes

Category
overall
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating

OLMo-7B-Instruct

946.42 rating

Confidence interval: 918.56 – 974.28

497 votes

Category
russian
Evaluated configuration
olmo-7b-instruct
Evaluation type
human preference

Run it locally

Inference · memory estimate

OLMo-7B-Instruct

12.8 GiB checkpoint tensor payload · 6.89 B stored tensor elements · BF16

Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.

Capabilities

Context window
2,048 tokens
Open weights
Yes
Model license
apache-2.0
Checkpoint tensor payload
12.83 GiB

Input modalities

  • text

Output modalities

  • text

Processing & platform

Architecture
hf_olmo