Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

Apple: diffucoder-7b-instruct

7 benchmarks
CompanyApple
Country of originUSA

Leaderboard position

#813
Overall rank (of 1121 models)
436
Elo rating
7
Benchmarks
Top 72.5%
Percentile
In Apple (of 13 models)

Benchmark highlights

Best benchmark
MBPP 75.1
Worst benchmark
BigCodeBench Hard 12.2

Nearest competitor from another company

The model from another company with the most similar benchmark scores.

appeared as nearest in 1 of 7 benchmarks

Benchmarks

Predicted scores

Estimated from 25 similar models and the global Elo rating. These are projections, not measured results.

Benchmark Predicted Confidence Based on
MATH-500 ~79.45 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
AIME 2025 ~51.01 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
GPQA Diamond ~48.29 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
MMLU-Pro ~50.73 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
IFEval ~76.37 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
Terminal-Bench v2.1 ~8.6 60% orcarouter: orcacyber-nano-1.0
MMLU ~57.26 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
Humanity's Last Exam (with tools) ~11.9 60% OpenAI: gpt-oss-20b
GSM8K ~67.21 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Qwen: qwen3-1.7b
BBH ~56.16 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
ARC-Challenge ~56.91 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
HellaSwag ~68.77 60% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Hugging Face Smol Models Research: smollm3-3b
PIQA ~78.94 60% Arcee AI: trinity-nano-base
SuperGPQA ~30.09 60% Qwen: qwen2.5-coder-7b-instruct, Qwen: Qwen3 8B, OpenAI: gpt-oss-20b
SWE-bench Verified ~25.49 59% Qwen: qwen2.5-coder-7b-instruct, Tencent: youtu-llm-2b, Qwen: Qwen3 4B
LiveCodeBench v6 ~45.76 59% Hugging Face Smol Models Research: smollm3-3b, Qwen: qwen3-1.7b, DeepSeek: deepseek-r1-distill-qwen-1.5b
GPQA ~36.85 59% Technology Innovation Institute: falcon-h1-1.5b-deep-instruct, Technology Innovation Institute: falcon-h1-1.5b-instruct, Technology Innovation Institute: falcon-h1-1.5b-deep-base
Artificial Analysis Intelligence Index v4.1 (Maximum Reasoning) ~9.41 59% Qwen: qwen3-1.7b, DeepSeek: deepseek-r1-distill-qwen-1.5b, OpenAI: gpt-4o
Artificial Analysis Intelligence Index v4.0 (Maximum Reasoning) ~15.99 59% Qwen: qwen3-1.7b, DeepSeek: deepseek-r1-distill-qwen-1.5b, Qwen: qwen2.5-coder-7b-instruct
WinoGrande ~67.83 59% Hugging Face Smol Models Research: smollm3-3b, Technology Innovation Institute: falcon-h1-1.5b-deep-base, Sber: gigachat3.5-432b-a28b-base
AIME 2026 ~64.9 58% Hugging Face Smol Models Research: smollm3-3b, webai-official: twil-8b
HMMT Feb 2026 ~57.06 58% Qwen: Qwen3 4B, webai-official: twil-8b
Humanity's Last Exam (no tools) ~4.45 58% webai-official: twil-8b, Qwen: Qwen3 8B, OpenAI: gpt-oss-20b
IFBench ~46.28 58% Hugging Face Smol Models Research: smollm3-3b, webai-official: twil-8b, orcarouter: orcacyber-nano-1.0
-(CoderPPL) ~-3.55 58% Hugging Face Smol Models Research: smollm3-3b, Tencent: youtu-llm-2b, Qwen: Qwen3 4B