ideogram: ideogram-4.0-quality
1 benchmarks
Leaderboard position
#371
Overall rank (of 1121 models)
1365
Elo rating
1
Benchmarks
Top 33.1%
Percentile
In ideogram (of 2 models)
Above: Moondream: Moondream 3 (Preview) #370
Below: Anthropic: claude-3.7-sonnet #372
Benchmark highlights
Nearest competitor from another company
The model from another company with the most similar benchmark scores.
appeared as nearest in 1 of 1 benchmarks
1/1
100.0%
Benchmarks
Predicted scores
Estimated from 25 similar models and the global Elo rating. These are projections, not measured results.
| Benchmark | Predicted | Confidence | Based on |
|---|---|---|---|
| MATH-500 | ~95.24 | 50% | — |
| AIME 2025 | ~82.85 | 50% | — |
| AIME 2026 | ~83.37 | 50% | — |
| HMMT Feb 2026 | ~74.92 | 50% | — |
| GPQA Diamond | ~69.32 | 50% | — |
| MMLU-Pro | ~73.75 | 50% | — |
| Humanity's Last Exam (no tools) | ~20.72 | 50% | — |
| IFEval | ~89.25 | 50% | — |
| IFBench | ~61.79 | 50% | — |
| HumanEval | ~88.54 | 50% | — |
| MBPP | ~93.7 | 50% | — |
| Terminal-Bench v2.1 | ~39.2 | 50% | — |
| MMLU | ~80.83 | 50% | — |
| SWE-bench Verified | ~55.21 | 50% | — |
| SWE-bench Pro | ~33.07 | 50% | — |
| SciCode | ~34.9 | 50% | — |
| AA-LCR | ~53.07 | 50% | — |
| Artificial Analysis Intelligence Index v5.0.1 | ~12 | 50% | — |
| Humanity's Last Exam (with tools) | ~27.99 | 50% | — |
| GSM8K | ~99.6 | 50% | — |
| -(CoderPPL) | ~-1.69 | 50% | — |
| LiveCodeBench v6 | ~67.59 | 50% | — |
| MMMU-Pro | ~62.54 | 50% | — |
| MATH | ~82.19 | 50% | — |
| BBH | ~76.66 | 50% | — |