Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

Apple: simplesd-4b-thinking

2 benchmarks
CompanyApple
Country of originUSA

Leaderboard position

#576
Overall rank (of 1121 models)
935
Elo rating
2
Benchmarks
Top 51.4%
Percentile
In Apple (of 13 models)

Benchmark highlights

Nearest competitor from another company

The model from another company with the most similar benchmark scores.

appeared as nearest in 1 of 2 benchmarks

Model Votes % of benchmarks
Sber: gigachat3.5-432b-a28b 1 50.0%
Mistral AI: Magistral Small 1.2 1 50.0%

Benchmarks

Predicted scores

Estimated from 25 similar models and the global Elo rating. These are projections, not measured results.

Benchmark Predicted Confidence Based on
MATH-500 ~87.78 50% —
AIME 2025 ~68.75 50% —
AIME 2026 ~75.05 50% —
HMMT Feb 2026 ~66.57 50% —
GPQA Diamond ~59.86 50% —
MMLU-Pro ~63.2 50% —
Humanity's Last Exam (no tools) ~13.07 50% —
IFEval ~83.38 50% —
IFBench ~54.67 50% —
HumanEval ~76.05 50% —
MBPP ~80.1 50% —
Terminal-Bench v2.1 ~24.3 50% —
MMLU ~69.75 50% —
SWE-bench Verified ~41.72 50% —
SWE-bench Pro ~20.49 50% —
SciCode ~28.18 50% —
AA-LCR ~44.67 50% —
Artificial Analysis Intelligence Index v5.0.1 ~12 50% —
Humanity's Last Exam (with tools) ~17.77 50% —
GSM8K ~85.85 50% —
-(CoderPPL) ~-1.69 50% —
MMMU-Pro ~54.47 50% —
MATH ~64.14 50% —
BBH ~67.12 50% —
ARC-Easy ~87.47 50% —