Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

Apple: simplesd-30b-instruct

2 benchmarks
CompanyApple
Country of originUSA

Leaderboard position

#646
Overall rank (of 1121 models)
767
Elo rating
2
Benchmarks
Top 57.6%
Percentile
In Apple (of 13 models)

Benchmark highlights

Nearest competitor from another company

The model from another company with the most similar benchmark scores.

appeared as nearest in 1 of 2 benchmarks

Model Votes % of benchmarks
Mistral AI: Magistral Small 1.2 1 50.0%
Sber: gigachat3.5-432b-a28b 1 50.0%

Benchmarks

Predicted scores

Estimated from 25 similar models and the global Elo rating. These are projections, not measured results.

Benchmark Predicted Confidence Based on
MATH-500 ~84.87 50% —
AIME 2025 ~63.23 50% —
AIME 2026 ~71.8 50% —
HMMT Feb 2026 ~63.31 50% —
GPQA Diamond ~56.16 50% —
MMLU-Pro ~59.08 50% —
Humanity's Last Exam (no tools) ~10.08 50% —
IFEval ~81.08 50% —
IFBench ~51.89 50% —
HumanEval ~71.17 50% —
MBPP ~73.71 50% —
Terminal-Bench v2.1 ~18.48 50% —
MMLU ~65.42 50% —
SWE-bench Verified ~36.45 50% —
SWE-bench Pro ~15.58 50% —
SciCode ~25.56 50% —
AA-LCR ~41.39 50% —
Artificial Analysis Intelligence Index v5.0.1 ~12 50% —
Humanity's Last Exam (with tools) ~13.78 50% —
GSM8K ~79.53 50% —
-(CoderPPL) ~-1.69 50% —
MMMU-Pro ~51.31 50% —
MATH ~57.09 50% —
BBH ~63.39 50% —
ARC-Easy ~82.23 50% —