gemini-pro-dev-api
Not enough verified architecture information for a reliable VRAM estimate.
GeekRadar / The comparison desk
COMPARE.
AI modelsgemini-pro-dev-api
Model evaluation
Capability & preference
Human preference · Arena
Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
Arena text preference / chinesehuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,124.04 rating
Confidence interval: 1,106.69 – 1,141.38
1867 votes
- Category
- chinese
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,103.80 rating
Confidence interval: 1,090.07 – 1,117.53
2681 votes
- Category
- coding
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,130.31 rating
Confidence interval: 1,116.51 – 1,144.10
3046 votes
- Category
- creative_writing
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,161.78 rating
Confidence interval: 1,153.40 – 1,170.17
12477 votes
- Category
- english
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,007.89 rating
Confidence interval: 997.46 – 1,018.33
12956 votes
- Category
- exclude_ties
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / experthuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,058.86 rating
Confidence interval: 1,035.67 – 1,082.04
694 votes
- Category
- expert
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / frenchhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,145.08 rating
Confidence interval: 1,112.47 – 1,177.68
462 votes
- Category
- french
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / germanhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,124.52 rating
Confidence interval: 1,094.80 – 1,154.25
450 votes
- Category
- german
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,109.17 rating
Confidence interval: 1,098.01 – 1,120.33
4515 votes
- Category
- hard_prompts
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,116.70 rating
Confidence interval: 1,104.17 – 1,129.23
3298 votes
- Category
- hard_prompts_english
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,130.69 rating
Confidence interval: 1,113.67 – 1,147.71
1672 votes
- Category
- industry_business_and_management_and_financial_operations
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,099.65 rating
Confidence interval: 1,085.73 – 1,113.57
2882 votes
- Category
- industry_entertainment_and_sports_and_media
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,166.06 rating
Confidence interval: 1,144.86 – 1,187.26
970 votes
- Category
- industry_legal_and_government
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,143.82 rating
Confidence interval: 1,130.24 – 1,157.41
3251 votes
- Category
- industry_life_and_physical_and_social_science
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,123.73 rating
Confidence interval: 1,108.80 – 1,138.66
1975 votes
- Category
- industry_mathematical
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,134.69 rating
Confidence interval: 1,114.13 – 1,155.24
1076 votes
- Category
- industry_medicine_and_healthcare
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,131.10 rating
Confidence interval: 1,119.75 – 1,142.45
4907 votes
- Category
- industry_software_and_it_services
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,143.96 rating
Confidence interval: 1,132.16 – 1,155.76
4634 votes
- Category
- industry_writing_and_literature_and_language
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,114.00 rating
Confidence interval: 1,103.54 – 1,124.45
5876 votes
- Category
- instruction_following
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / japanesehuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,022.55 rating
Confidence interval: 977.71 – 1,067.40
173 votes
- Category
- japanese
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,131.40 rating
Confidence interval: 1,113.80 – 1,149.01
1351 votes
- Category
- longer_query
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,132.00 rating
Confidence interval: 1,118.16 – 1,145.84
2274 votes
- Category
- math
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,124.22 rating
Confidence interval: 1,109.72 – 1,138.73
2528 votes
- Category
- multi_turn
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,137.95 rating
Confidence interval: 1,127.32 – 1,148.59
5877 votes
- Category
- non_english
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,148.81 rating
Confidence interval: 1,141.62 – 1,156.00
18354 votes
- Category
- overall
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,185.98 rating
Confidence interval: 1,165.90 – 1,206.06
953 votes
- Category
- russian
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Arena text preference / spanishhuman preference · 2026-10-15 · rating
gemini-pro-dev-api
1,118.85 rating
Confidence interval: 1,077.23 – 1,160.47
213 votes
- Category
- spanish
- Evaluated configuration
- gemini-pro-dev-api
- Evaluation type
- human preference
Run it locally
Capabilities
- Model license
- Proprietary
0 selected Compare 0