GeekRadar / The comparison desk
COMPARE.
AI models
Not reported

Zephyr 7B Beta

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

Zephyr 7B Beta 1069.4 Zephyr 7B Beta · 95% interval 1060.7–1078.1 · 11,118 votes · 2026-10-28

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

Zephyr 7B Beta

959.91 rating

Confidence interval: 929.54 – 990.29

373 votes

Category
chinese
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,044.32 rating

Confidence interval: 1,026.27 – 1,062.36

1250 votes

Category
coding
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,102.00 rating

Confidence interval: 1,086.10 – 1,117.89

1993 votes

Category
creative_writing
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,107.36 rating

Confidence interval: 1,097.82 – 1,116.90

8764 votes

Category
english
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

Zephyr 7B Beta

888.26 rating

Confidence interval: 875.98 – 900.53

7522 votes

Category
exclude_ties
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,005.72 rating

Confidence interval: 968.26 – 1,043.17

201 votes

Category
expert
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,031.23 rating

Confidence interval: 982.26 – 1,080.21

153 votes

Category
french
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

989.01 rating

Confidence interval: 941.20 – 1,036.83

152 votes

Category
german
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,026.48 rating

Confidence interval: 1,012.28 – 1,040.68

2220 votes

Category
hard_prompts
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,047.65 rating

Confidence interval: 1,032.32 – 1,062.98

1847 votes

Category
hard_prompts_english
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,000.39 rating

Confidence interval: 980.13 – 1,020.64

997 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,062.55 rating

Confidence interval: 1,046.67 – 1,078.43

1869 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,095.11 rating

Confidence interval: 1,069.51 – 1,120.71

621 votes

Category
industry_legal_and_government
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,059.97 rating

Confidence interval: 1,044.26 – 1,075.68

1996 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,044.40 rating

Confidence interval: 1,026.25 – 1,062.54

1113 votes

Category
industry_mathematical
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,026.99 rating

Confidence interval: 1,000.76 – 1,053.22

580 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,048.11 rating

Confidence interval: 1,033.99 – 1,062.22

2598 votes

Category
industry_software_and_it_services
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,085.66 rating

Confidence interval: 1,071.72 – 1,099.60

2691 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,031.37 rating

Confidence interval: 1,018.72 – 1,044.02

3094 votes

Category
instruction_following
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,041.34 rating

Confidence interval: 1,014.49 – 1,068.18

461 votes

Category
longer_query
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,040.91 rating

Confidence interval: 1,024.05 – 1,057.77

1250 votes

Category
math
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,037.93 rating

Confidence interval: 1,020.43 – 1,055.43

1574 votes

Category
multi_turn
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

987.53 rating

Confidence interval: 973.24 – 1,001.82

2354 votes

Category
non_english
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,069.40 rating

Confidence interval: 1,060.70 – 1,078.09

11118 votes

Category
overall
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,061.86 rating

Confidence interval: 1,023.97 – 1,099.74

202 votes

Category
russian
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-10-28 · rating

Zephyr 7B Beta

1,073.49 rating

Confidence interval: 1,018.09 – 1,128.89

127 votes

Category
spanish
Evaluated configuration
Zephyr 7B Beta
Evaluation type
human preference

Run it locally

Inference · memory estimate

Zephyr 7B Beta

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
MIT