GeekRadar / The comparison desk
COMPARE.
AI models
anthropic

Claude 3.7 Sonnet

AI model Released

Open weights
No*

Capability & preference

General capability · ECI

A cross-benchmark capability estimate. Index points, not a percentage; intervals show uncertainty.

Claude 3.7 Sonnet 141.0* Claude 3.7 Sonnet · 95% interval 139.3–142.5

Model performance

Radar task score: four tests, equal weight. An experimental summary of these tasks, not a universal intelligence rating.

Claude 3.7 Sonnet

Radar task score

Unrated

1/4 core tests · not enough evidence

1 benchmark results for this configuration

Scientific reasoning

GPQA Diamond · 25%

Expert-written science questions; strict multiple-choice scoring. Chance accuracy is 25%.

Claude 3.7 Sonnet 78.5*% Approx. 95% interval: 73.3–83.7% · Older result

Novel problem solving

Mystery Game Puzzles · 25%

Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.

Claude 3.7 Sonnet Not available

Advanced mathematics

FrontierMath Tiers 1-3 · 25%

Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.

Claude 3.7 Sonnet Not available

Factual answers

SimpleQA Verified · 25%

Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.

Claude 3.7 Sonnet Not available

Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.

Run it locally

Inference · memory estimate

Claude 3.7 Sonnet

Closed weights. No supported local deployment or GPU requirement is published.

Capabilities

Open weights
No*

System configuration

Detailed specifications

Specifications · 4 fields
Access model
API access*
Open weights
No*
Organization
Anthropic*
Organization country
United States of America*

* Provisional data