GeekRadar / The comparison desk
COMPARE.
AI models
Not reported

vicuna-7b

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

vicuna-7b 1030.9 vicuna-7b · 95% interval 1021.8–1040.0 · 6,923 votes · 2026-10-15

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-15 · rating

vicuna-7b

979.02 rating

Confidence interval: 946.20 – 1,011.83

335 votes

Category
chinese
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating

vicuna-7b

1,009.84 rating

Confidence interval: 987.45 – 1,032.22

726 votes

Category
coding
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating

vicuna-7b

1,020.94 rating

Confidence interval: 1,003.11 – 1,038.76

1323 votes

Category
creative_writing
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating

vicuna-7b

1,051.25 rating

Confidence interval: 1,041.37 – 1,061.12

5577 votes

Category
english
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating

vicuna-7b

840.88 rating

Confidence interval: 827.73 – 854.03

4750 votes

Category
exclude_ties
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating

vicuna-7b

994.75 rating

Confidence interval: 978.12 – 1,011.37

1258 votes

Category
hard_prompts
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating

vicuna-7b

1,004.23 rating

Confidence interval: 985.88 – 1,022.58

1066 votes

Category
hard_prompts_english
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating

vicuna-7b

972.64 rating

Confidence interval: 945.33 – 999.94

555 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating

vicuna-7b

1,016.55 rating

Confidence interval: 999.17 – 1,033.94

1285 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating

vicuna-7b

1,031.81 rating

Confidence interval: 996.86 – 1,066.76

305 votes

Category
industry_legal_and_government
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating

vicuna-7b

1,000.87 rating

Confidence interval: 982.12 – 1,019.62

1171 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating

vicuna-7b

979.95 rating

Confidence interval: 956.30 – 1,003.60

590 votes

Category
industry_mathematical
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating

vicuna-7b

997.78 rating

Confidence interval: 962.08 – 1,033.48

291 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating

vicuna-7b

1,017.11 rating

Confidence interval: 1,001.01 – 1,033.21

1601 votes

Category
industry_software_and_it_services
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating

vicuna-7b

1,048.57 rating

Confidence interval: 1,033.59 – 1,063.55

1783 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating

vicuna-7b

993.66 rating

Confidence interval: 979.79 – 1,007.53

2020 votes

Category
instruction_following
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating

vicuna-7b

1,035.29 rating

Confidence interval: 992.48 – 1,078.09

162 votes

Category
longer_query
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating

vicuna-7b

993.75 rating

Confidence interval: 972.37 – 1,015.14

658 votes

Category
math
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating

vicuna-7b

987.81 rating

Confidence interval: 966.89 – 1,008.72

935 votes

Category
multi_turn
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating

vicuna-7b

1,002.93 rating

Confidence interval: 986.31 – 1,019.54

1346 votes

Category
non_english
Evaluated configuration
vicuna-7b
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating

vicuna-7b

1,030.90 rating

Confidence interval: 1,021.83 – 1,039.98

6923 votes

Category
overall
Evaluated configuration
vicuna-7b
Evaluation type
human preference

Run it locally

Inference · memory estimate

vicuna-7b

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Llama 2 Community