GeekRadar / The comparison desk
COMPARE.
AI models
openai

GPT-4o mini (2024-07-18)

Model evaluation

Capability & preference

Human preference · Arena

Overall text preferences from head-to-head votes. Not factual accuracy or a task-success rate.

GPT-4o mini (2024-07-18) 1286.4 GPT-4o mini (2024-07-18) · 95% interval 1282.9–1289.9 · 68,705 votes · 2026-11-09

Recorded results

Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.

Arena text preference / chinesehuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,264.66 rating

Confidence interval: 1,255.47 – 1,273.85

5778 votes

Category
chinese
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,289.51 rating

Confidence interval: 1,282.99 – 1,296.02

10928 votes

Category
coding
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,267.68 rating

Confidence interval: 1,260.75 – 1,274.60

10486 votes

Category
creative_writing
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,300.59 rating

Confidence interval: 1,296.29 – 1,304.88

37735 votes

Category
english
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,215.92 rating

Confidence interval: 1,210.68 – 1,221.17

43353 votes

Category
exclude_ties
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,234.02 rating

Confidence interval: 1,223.24 – 1,244.80

3550 votes

Category
expert
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,296.45 rating

Confidence interval: 1,271.89 – 1,321.01

649 votes

Category
french
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,271.88 rating

Confidence interval: 1,256.41 – 1,287.35

1641 votes

Category
german
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,266.82 rating

Confidence interval: 1,261.53 – 1,272.11

18259 votes

Category
hard_prompts
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,278.35 rating

Confidence interval: 1,271.96 – 1,284.75

11355 votes

Category
hard_prompts_english
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,264.72 rating

Confidence interval: 1,256.95 – 1,272.49

7765 votes

Category
industry_business_and_management_and_financial_operations
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_entertainment_and_sports_and_mediahuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,253.24 rating

Confidence interval: 1,246.72 – 1,259.76

11284 votes

Category
industry_entertainment_and_sports_and_media
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_legal_and_governmenthuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,305.33 rating

Confidence interval: 1,294.52 – 1,316.15

3866 votes

Category
industry_legal_and_government
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_life_and_physical_and_social_sciencehuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,286.04 rating

Confidence interval: 1,279.40 – 1,292.68

11641 votes

Category
industry_life_and_physical_and_social_science
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_mathematicalhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,271.51 rating

Confidence interval: 1,264.12 – 1,278.91

7966 votes

Category
industry_mathematical
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_medicine_and_healthcarehuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,281.74 rating

Confidence interval: 1,270.39 – 1,293.09

3439 votes

Category
industry_medicine_and_healthcare
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_software_and_it_serviceshuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,290.69 rating

Confidence interval: 1,285.17 – 1,296.21

17795 votes

Category
industry_software_and_it_services
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / industry_writing_and_literature_and_languagehuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,281.93 rating

Confidence interval: 1,276.33 – 1,287.52

18532 votes

Category
industry_writing_and_literature_and_language
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / instruction_followinghuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,258.23 rating

Confidence interval: 1,253.41 – 1,263.04

26707 votes

Category
instruction_following
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / japanesehuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,215.87 rating

Confidence interval: 1,200.30 – 1,231.45

1793 votes

Category
japanese
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / koreanhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,195.31 rating

Confidence interval: 1,174.70 – 1,215.91

1087 votes

Category
korean
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / longer_queryhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,288.72 rating

Confidence interval: 1,281.67 – 1,295.76

8989 votes

Category
longer_query
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / mathhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,267.35 rating

Confidence interval: 1,260.33 – 1,274.37

9322 votes

Category
math
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / multi_turnhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,284.92 rating

Confidence interval: 1,278.22 – 1,291.62

12279 votes

Category
multi_turn
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / non_englishhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,266.17 rating

Confidence interval: 1,261.62 – 1,270.72

30970 votes

Category
non_english
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / overallhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,286.38 rating

Confidence interval: 1,282.86 – 1,289.91

68705 votes

Category
overall
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / polishhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,243.81 rating

Confidence interval: 1,178.26 – 1,309.37

65 votes

Category
polish
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / russianhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,275.13 rating

Confidence interval: 1,267.67 – 1,282.58

8268 votes

Category
russian
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference
Arena text preference / spanishhuman preference · 2026-11-09 · rating

GPT-4o mini (2024-07-18)

1,275.94 rating

Confidence interval: 1,252.19 – 1,299.69

741 votes

Category
spanish
Evaluated configuration
GPT-4o mini (2024-07-18)
Evaluation type
human preference

Run it locally

Inference · memory estimate

GPT-4o mini (2024-07-18)

Not enough verified architecture information for a reliable VRAM estimate.

Capabilities

Model license
Proprietary