Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.
050100%
gemma-3-1b-itNot available
Advanced mathematics
FrontierMath Tiers 1-3 · 25%
Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.
050100%
gemma-3-1b-itNot available
Factual answers
SimpleQA Verified · 25%
Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.
050100%
gemma-3-1b-itNot available
Competition mathematics
OTIS Mock AIME 2024-2025 · Separate result
Competition problems with model-extracted answers checked against an exact key. Earlier grading procedures are excluded.
050100%
gemma-3-1b-it1.1*%Approx. 95% interval: 0.1–2.2%
Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.
Run it locally
Inference · memory estimate
gemma-3-1b-it
1.9 GiB checkpoint tensor payload · 1.00 B stored tensor elements · BF16
Stored tensors can include buffers and repeated shared weights. A verified unique parameter count is unavailable. Checkpoint size is not the memory required to run the model.