Radar task score: four tests, equal weight. An experimental summary of these tasks, not a universal intelligence rating.
Muse Spark
Radar task score
/ 100
1/4 core tests · not enough evidence
2 benchmark results for this configuration
Scientific reasoning
GPQA Diamond · 25%
Expert-written science questions; strict multiple-choice scoring. Chance accuracy is 25%.
050100%
Muse Spark89.8*%Approx. 95% interval: 85.5–94.1% · Older result
Novel problem solving
Mystery Game Puzzles · 25%
Best-next-move puzzles in an undisclosed game variant. A narrow reasoning test, not general intelligence.
050100%
Muse SparkNot available
Advanced mathematics
FrontierMath Tiers 1-3 · 25%
Private v2 mathematics problems with Python tools. Earlier versions and Tier 4 are excluded.
050100%
Muse SparkNot available
Factual answers
SimpleQA Verified · 25%
Correct factual answers under a guessing prompt, graded by a model. Not a hallucination or abstention score.
050100%
Muse SparkNot available
Competition mathematics
OTIS Mock AIME 2024-2025 · Separate result
Competition problems with model-extracted answers checked against an exact key. Earlier grading procedures are excluded.
050100%
Muse Spark88.9*%Approx. 95% interval: 79.7–98.1% · Older result
Bars show reported task scores. Whiskers are approximate 95% intervals where standard errors are available. Different reasoning budgets are not equal-cost tests. Missing results are never zero.
Recorded results
Only the same benchmark, version, workload, scenario and unit share a row. Missing results are not zero. System results include the full submitted hardware and software configuration.
Arena text preference / chinesehuman preference · 2026-10-28 · rating
Muse Spark
1,507.35 rating
Confidence interval: 1,487.57 – 1,527.14
976 votes
Category
chinese
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / codinghuman preference · 2026-10-28 · rating
Muse Spark
1,481.31 rating
Confidence interval: 1,471.46 – 1,491.15
3941 votes
Category
coding
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / creative_writinghuman preference · 2026-10-28 · rating
Muse Spark
1,458.71 rating
Confidence interval: 1,445.12 – 1,472.31
2038 votes
Category
creative_writing
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / englishhuman preference · 2026-10-28 · rating
Muse Spark
1,480.28 rating
Confidence interval: 1,472.65 – 1,487.92
6679 votes
Category
english
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / exclude_tieshuman preference · 2026-10-28 · rating
Muse Spark
1,479.32 rating
Confidence interval: 1,471.90 – 1,486.74
10714 votes
Category
exclude_ties
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / experthuman preference · 2026-10-28 · rating
Muse Spark
1,457.14 rating
Confidence interval: 1,441.16 – 1,473.12
1377 votes
Category
expert
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / frenchhuman preference · 2026-10-28 · rating
Muse Spark
1,495.58 rating
Confidence interval: 1,467.53 – 1,523.64
478 votes
Category
french
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / germanhuman preference · 2026-10-28 · rating
Muse Spark
1,498.05 rating
Confidence interval: 1,459.06 – 1,537.03
236 votes
Category
german
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / hard_promptshuman preference · 2026-10-28 · rating
Muse Spark
1,474.20 rating
Confidence interval: 1,467.38 – 1,481.03
9155 votes
Category
hard_prompts
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / hard_prompts_englishhuman preference · 2026-10-28 · rating
Muse Spark
1,477.24 rating
Confidence interval: 1,468.03 – 1,486.44
4506 votes
Category
hard_prompts_english
Evaluated configuration
Muse Spark
Evaluation type
human preference
Arena text preference / industry_business_and_management_and_financial_operationshuman preference · 2026-10-28 · rating