GPT-3.5 Turbo (Jan 2024)

AI model Released Jan 25, 2024

Open weights: No^*

Capability & preference

General capability · ECI

A cross-benchmark capability estimate. Index points, not a percentage; intervals show uncertainty.

GPT-3.5 Turbo (Jan 2024) 113.2^* GPT-3.5 Turbo (Jan 2024) · 95% interval 108.2–117.8

Model performance

Radar task score: four tests, equal weight. An experimental summary of these tasks, not a universal intelligence rating.

GPT-3.5 Turbo (Jan 2024)

Tested configuration Radar task score

Unrated

3/4 core tests · not enough evidence

4 benchmark results for this configuration

Scientific reasoning

GPQA Diamond · 25%

Expert-written science questions; strict multiple-choice scoring. Chance accuracy is 25%.

GPT-3.5 Turbo (Jan 2024) 27.2^*% Approx. 95% interval: 23.3–31.0% · 2025-01-27 · Older result

Novel problem solving

Mystery Game Puzzles · 25%

Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.

GPT-3.5 Turbo (Jan 2024) 3.0^*% Approx. 95% interval: 0.0–6.4% · 2026-08-27

Advanced mathematics

FrontierMath Tiers 1-3 · 25%

Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.

GPT-3.5 Turbo (Jan 2024) 0.0^*% Uncertainty not available · 2026-08-27

Factual answers

SimpleQA Verified · 25%

Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.

GPT-3.5 Turbo (Jan 2024) Not available

Competition mathematics

OTIS Mock AIME 2024-2025 · Separate result

Competition problems with model-extracted answers checked against an exact key. Earlier grading procedures are excluded.

GPT-3.5 Turbo (Jan 2024) 2.2^*% Approx. 95% interval: 0.0–6.6% · 2026-08-07

Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.

Run it locally

Inference · memory estimate

GPT-3.5 Turbo (Jan 2024)

Closed weights. No supported local deployment or GPU requirement is published.

Capabilities

Open weights: No^*

System configuration

Detailed specifications

Specifications · 4 fields

Access model: API access^*
Open weights: No^*
Organization: OpenAI^*
Organization country: United States of America^*

* Provisional data