o1-2024-12-17
Not enough verified architecture information for a reliable VRAM estimate.
GeekRadar / The comparison desk
COMPARE.
AI modelso1-2024-12-17
Model evaluation
Capability & preference
Human preference · Arena
Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
Arena text preference / chinesehuman preference · 2026-10-15 · rating
o1-2024-12-17
1,393.88 rating
Confidence interval: 1,379.52 – 1,408.25
1780 votes
- Category
- chinese
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / codinghuman preference · 2026-10-15 · rating
o1-2024-12-17
1,366.72 rating
Confidence interval: 1,357.17 – 1,376.27
3973 votes
- Category
- coding
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / creative_writinghuman preference · 2026-10-15 · rating
o1-2024-12-17
1,347.32 rating
Confidence interval: 1,338.28 – 1,356.36
4642 votes
- Category
- creative_writing
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / englishhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,372.16 rating
Confidence interval: 1,366.61 – 1,377.70
16316 votes
- Category
- english
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / exclude_tieshuman preference · 2026-10-15 · rating
o1-2024-12-17
1,333.50 rating
Confidence interval: 1,327.07 – 1,339.92
19214 votes
- Category
- exclude_ties
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / experthuman preference · 2026-10-15 · rating
o1-2024-12-17
1,361.29 rating
Confidence interval: 1,344.47 – 1,378.11
1330 votes
- Category
- expert
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / frenchhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,343.91 rating
Confidence interval: 1,306.95 – 1,380.86
252 votes
- Category
- french
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / germanhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,336.85 rating
Confidence interval: 1,312.68 – 1,361.02
556 votes
- Category
- german
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / hard_promptshuman preference · 2026-10-15 · rating
o1-2024-12-17
1,371.35 rating
Confidence interval: 1,363.70 – 1,379.01
6453 votes
- Category
- hard_prompts
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,371.92 rating
Confidence interval: 1,362.56 – 1,381.29
4238 votes
- Category
- hard_prompts_english
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-15 · rating
o1-2024-12-17
1,327.58 rating
Confidence interval: 1,315.97 – 1,339.19
2720 votes
- Category
- industry_business_and_management_and_financial_operations
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-15 · rating
o1-2024-12-17
1,358.07 rating
Confidence interval: 1,349.52 – 1,366.62
5210 votes
- Category
- industry_entertainment_and_sports_and_media
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-15 · rating
o1-2024-12-17
1,368.02 rating
Confidence interval: 1,352.31 – 1,383.74
1454 votes
- Category
- industry_legal_and_government
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-15 · rating
o1-2024-12-17
1,368.77 rating
Confidence interval: 1,359.91 – 1,377.62
4820 votes
- Category
- industry_life_and_physical_and_social_science
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_mathematicalhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,389.54 rating
Confidence interval: 1,378.06 – 1,401.03
2644 votes
- Category
- industry_mathematical
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-15 · rating
o1-2024-12-17
1,354.87 rating
Confidence interval: 1,337.84 – 1,371.90
1273 votes
- Category
- industry_medicine_and_healthcare
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-15 · rating
o1-2024-12-17
1,366.35 rating
Confidence interval: 1,358.69 – 1,374.02
6584 votes
- Category
- industry_software_and_it_services
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-15 · rating
o1-2024-12-17
1,360.03 rating
Confidence interval: 1,352.71 – 1,367.34
7663 votes
- Category
- industry_writing_and_literature_and_language
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / instruction_followinghuman preference · 2026-10-15 · rating
o1-2024-12-17
1,367.19 rating
Confidence interval: 1,360.68 – 1,373.70
10246 votes
- Category
- instruction_following
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / japanesehuman preference · 2026-10-15 · rating
o1-2024-12-17
1,345.98 rating
Confidence interval: 1,319.98 – 1,371.98
581 votes
- Category
- japanese
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / koreanhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,396.08 rating
Confidence interval: 1,364.37 – 1,427.80
396 votes
- Category
- korean
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / longer_queryhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,377.53 rating
Confidence interval: 1,367.68 – 1,387.39
3571 votes
- Category
- longer_query
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / mathhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,388.34 rating
Confidence interval: 1,377.52 – 1,399.15
2986 votes
- Category
- math
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / multi_turnhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,354.75 rating
Confidence interval: 1,345.57 – 1,363.93
4399 votes
- Category
- multi_turn
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / non_englishhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,358.46 rating
Confidence interval: 1,352.37 – 1,364.55
11491 votes
- Category
- non_english
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / overallhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,365.79 rating
Confidence interval: 1,361.31 – 1,370.26
27807 votes
- Category
- overall
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / russianhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,355.73 rating
Confidence interval: 1,345.19 – 1,366.27
3078 votes
- Category
- russian
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Arena text preference / spanishhuman preference · 2026-10-15 · rating
o1-2024-12-17
1,345.00 rating
Confidence interval: 1,296.78 – 1,393.22
142 votes
- Category
- spanish
- Evaluated configuration
- o1-2024-12-17
- Evaluation type
- human preference
Run it locally
Capabilities
- Model license
- Proprietary
0 selected Compare 0