GeekRadar / The comparison desk

COMPARE.

AI models

openai

o1-mini

AI model Released Sep 12, 2024

Capability & preference

General capability · ECI

A cross-benchmark capability estimate. Index points, not a percentage; intervals show uncertainty.

o1-mini 135.4^* o1-mini · 95% interval 133.1–137.5

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

o1-mini 1317.1 o1-mini · 95% interval 1313.4–1320.7 · 51,981 votes · 2026-10-28

Model performance

Radar task score: four tests, equal weight. An experimental summary of these tasks, not a universal intelligence rating.

o1-mini

Tested configuration Radar task score

Unrated

1/4 core tests · not enough evidence

1 benchmark results for this configuration

Scientific reasoning

GPQA Diamond · 25%

Expert-written science questions; strict multiple-choice scoring. Chance accuracy is 25%.

o1-mini 62.4^*% Approx. 95% interval: 57.0–67.7% · 2025-02-13 · Older result

Novel problem solving

Mystery Game Puzzles · 25%

Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.

o1-mini Not available

Advanced mathematics

FrontierMath Tiers 1-3 · 25%

Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.

o1-mini Not available

Factual answers

SimpleQA Verified · 25%

Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.

o1-mini Not available

Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-10-28 · rating

o1-mini

1,314.08 rating

Confidence interval: 1,303.89 – 1,324.26

4309 votes

Oct 28, 2026

Category: chinese
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / codinghuman preference · 2026-10-28 · rating

o1-mini

1,362.02 rating

Confidence interval: 1,354.67 – 1,369.38

8478 votes

Oct 28, 2026

Category: coding
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / creative_writinghuman preference · 2026-10-28 · rating

o1-mini

1,243.97 rating

Confidence interval: 1,236.35 – 1,251.58

7858 votes

Oct 28, 2026

Category: creative_writing
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / englishhuman preference · 2026-10-28 · rating

o1-mini

1,340.07 rating

Confidence interval: 1,335.31 – 1,344.83

27352 votes

Oct 28, 2026

Category: english
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating

o1-mini

1,262.45 rating

Confidence interval: 1,256.96 – 1,267.94

34410 votes

Oct 28, 2026

Category: exclude_ties
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / experthuman preference · 2026-10-28 · rating

o1-mini

1,315.60 rating

Confidence interval: 1,303.96 – 1,327.23

3191 votes

Oct 28, 2026

Category: expert
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / frenchhuman preference · 2026-10-28 · rating

o1-mini

1,293.45 rating

Confidence interval: 1,263.54 – 1,323.36

424 votes

Oct 28, 2026

Category: french
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / germanhuman preference · 2026-10-28 · rating

o1-mini

1,278.06 rating

Confidence interval: 1,259.95 – 1,296.18

1169 votes

Oct 28, 2026

Category: german
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / hard_promptshuman preference · 2026-10-28 · rating

o1-mini

1,333.03 rating

Confidence interval: 1,327.06 – 1,338.99

13899 votes

Oct 28, 2026

Category: hard_prompts
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating

o1-mini

1,351.26 rating

Confidence interval: 1,343.91 – 1,358.60

8369 votes

Oct 28, 2026

Category: hard_prompts_english
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating

o1-mini

1,286.94 rating

Confidence interval: 1,278.42 – 1,295.47

6092 votes

Oct 28, 2026

Category: industry_business_and_management_and_financial_operations
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-10-28 · rating

o1-mini

1,256.81 rating

Confidence interval: 1,249.65 – 1,263.98

8598 votes

Oct 28, 2026

Category: industry_entertainment_and_sports_and_media
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_legal_and_governmenthuman preference · 2026-10-28 · rating

o1-mini

1,315.39 rating

Confidence interval: 1,303.69 – 1,327.08

3138 votes

Oct 28, 2026

Category: industry_legal_and_government
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-10-28 · rating

o1-mini

1,315.77 rating

Confidence interval: 1,308.50 – 1,323.05

8979 votes

Oct 28, 2026

Category: industry_life_and_physical_and_social_science
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_mathematicalhuman preference · 2026-10-28 · rating

o1-mini

1,366.27 rating

Confidence interval: 1,357.82 – 1,374.72

6318 votes

Oct 28, 2026

Category: industry_mathematical
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-10-28 · rating

o1-mini

1,296.69 rating

Confidence interval: 1,284.05 – 1,309.33

2639 votes

Oct 28, 2026

Category: industry_medicine_and_healthcare
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_software_and_it_serviceshuman preference · 2026-10-28 · rating

o1-mini

1,353.69 rating

Confidence interval: 1,347.50 – 1,359.88

13214 votes

Oct 28, 2026

Category: industry_software_and_it_services
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-10-28 · rating

o1-mini

1,279.87 rating

Confidence interval: 1,273.80 – 1,285.95

14272 votes

Oct 28, 2026

Category: industry_writing_and_literature_and_language
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / instruction_followinghuman preference · 2026-10-28 · rating

o1-mini

1,303.88 rating

Confidence interval: 1,298.63 – 1,309.13

21478 votes

Oct 28, 2026

Category: instruction_following
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / japanesehuman preference · 2026-10-28 · rating

o1-mini

1,245.04 rating

Confidence interval: 1,226.39 – 1,263.69

1093 votes

Oct 28, 2026

Category: japanese
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / koreanhuman preference · 2026-10-28 · rating

o1-mini

1,222.82 rating

Confidence interval: 1,198.84 – 1,246.79

716 votes

Oct 28, 2026

Category: korean
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / longer_queryhuman preference · 2026-10-28 · rating

o1-mini

1,320.13 rating

Confidence interval: 1,312.55 – 1,327.70

7913 votes

Oct 28, 2026

Category: longer_query
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / mathhuman preference · 2026-10-28 · rating

o1-mini

1,358.18 rating

Confidence interval: 1,350.31 – 1,366.06

7499 votes

Oct 28, 2026

Category: math
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / multi_turnhuman preference · 2026-10-28 · rating

o1-mini

1,313.95 rating

Confidence interval: 1,306.58 – 1,321.32

9326 votes

Oct 28, 2026

Category: multi_turn
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / non_englishhuman preference · 2026-10-28 · rating

o1-mini

1,288.43 rating

Confidence interval: 1,283.58 – 1,293.28

24629 votes

Oct 28, 2026

Category: non_english
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / overallhuman preference · 2026-10-28 · rating

o1-mini

1,317.05 rating

Confidence interval: 1,313.42 – 1,320.69

51981 votes

Oct 28, 2026

Category: overall
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / russianhuman preference · 2026-10-28 · rating

o1-mini

1,282.35 rating

Confidence interval: 1,274.44 – 1,290.26

7413 votes

Oct 28, 2026

Category: russian
Evaluated configuration: o1-mini
Evaluation type: human preference

Arena text preference / spanishhuman preference · 2026-10-28 · rating

o1-mini

1,302.74 rating

Confidence interval: 1,274.85 – 1,330.64

425 votes

Oct 28, 2026

Category: spanish
Evaluated configuration: o1-mini
Evaluation type: human preference

Run it locally

Inference · memory estimate

o1-mini

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license: Proprietary

* Provisional data