Apple: simplesd-30b-instruct
2 benchmarks
Leaderboard position
#646
Overall rank (of 1121 models)
767
Elo rating
2
Benchmarks
Top 57.6%
Percentile
In Apple (of 13 models)
Above: Sber: gigachat-2-pro #645
Below: Black Forest Labs: flux.1-kontext-max #647
Benchmark highlights
Best benchmark
LiveCodeBench v6
55.3
Worst benchmark
LiveCodeBench v5
54.3
Nearest competitor from another company
The model from another company with the most similar benchmark scores.
appeared as nearest in 1 of 2 benchmarks
1/2
50.0%
1/2
50.0%
| Model | Votes | % of benchmarks |
|---|---|---|
| Mistral AI: Magistral Small 1.2 | 1 | 50.0% |
| Sber: gigachat3.5-432b-a28b | 1 | 50.0% |
Benchmarks
Predicted scores
Estimated from 25 similar models and the global Elo rating. These are projections, not measured results.
| Benchmark | Predicted | Confidence | Based on |
|---|---|---|---|
| MATH-500 | ~84.87 | 50% | — |
| AIME 2025 | ~63.23 | 50% | — |
| AIME 2026 | ~71.8 | 50% | — |
| HMMT Feb 2026 | ~63.31 | 50% | — |
| GPQA Diamond | ~56.16 | 50% | — |
| MMLU-Pro | ~59.08 | 50% | — |
| Humanity's Last Exam (no tools) | ~10.08 | 50% | — |
| IFEval | ~81.08 | 50% | — |
| IFBench | ~51.89 | 50% | — |
| HumanEval | ~71.17 | 50% | — |
| MBPP | ~73.71 | 50% | — |
| Terminal-Bench v2.1 | ~18.48 | 50% | — |
| MMLU | ~65.42 | 50% | — |
| SWE-bench Verified | ~36.45 | 50% | — |
| SWE-bench Pro | ~15.58 | 50% | — |
| SciCode | ~25.56 | 50% | — |
| AA-LCR | ~41.39 | 50% | — |
| Artificial Analysis Intelligence Index v5.0.1 | ~12 | 50% | — |
| Humanity's Last Exam (with tools) | ~13.78 | 50% | — |
| GSM8K | ~79.53 | 50% | — |
| -(CoderPPL) | ~-1.69 | 50% | — |
| MMMU-Pro | ~51.31 | 50% | — |
| MATH | ~57.09 | 50% | — |
| BBH | ~63.39 | 50% | — |
| ARC-Easy | ~82.23 | 50% | — |