Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

HellaSwag

79 models

HellaSwag — a benchmark by the University of Washington and Allen AI (Rowan Zellers et al., ACL 2019). Given an event description, the model must pick the most likely follow-up from 4 choices — testing commonsense reasoning. Built via Adversarial Filtering: wrong answers that are ridiculous to humans but plausible to models are iteratively generated. Humans score >95%, SOTA models originally scored <48%. Metric: accuracy.

Top 5 Models Performance

Anthropic: claude-3-opus ######################################## 95.4
NON AI - НЕ ИИ: Human baseline - Человеческий результат ######################################## 95
Xiaomi: MiMo-V2.5 Pro ###################################### 89.8
Sber: gigachat3.5-432b-a28b-base ###################################### 89.47
Google: Gemma 3 27B Pretrained #################################### 85.6
– 970 – 1.1T
– 2019 – 2026
Rank Model Score
🇺🇸 1 Anthropic: claude-3-opus 95.4
- 2 NON AI - НЕ ИИ: Human baseline - Человеческий результат 95
🇨🇳 3 Xiaomi: MiMo-V2.5 Pro小米集团 89.8
🇷🇺 4 Sber: gigachat3.5-432b-a28b-baseСбер 89.47
🇺🇸 5 Google: Gemma 3 27B Pretrained 85.6
🇺🇸 6 Google: gemma-3-12b-pt 84.2
❓ 7 davidau: qwen3.8-27b-turbo-fable-cold-fusion-neo-735-882-heretic-uncensored-neo-coder-max-mtp 83.2
🇺🇸 8 Amazon: MistralLite 81.617
🇨🇳 9 Qwen: qwen-14b通义千问 80.2
🇨🇳 10 Qwen: Qwen3.5 9B通义千问 78.75
🇨🇳 11 Qwen: qwen3.5-9b-base通义千问 78
🇷🇺 12 T-Tech: t-lite-it-1.0 78
🇺🇸 13 Arcee AI: trinity-nano-base 77.4
🇺🇸 14 IBM Granite: granite-4.1-3b 77.3
🇺🇸 15 Google: gemma-3-4b-pt 77.2
🇺🇸 16 Apple: openelm-3b-instruct 76.36
🇺🇸 17 Hugging Face Smol Models Research: smollm3-3b-base 75.25
🇨🇳 18 Qwen: qwen-7b通义千问 75.1
🇺🇸 19 Hugging Face Smol Models Research: smollm3-3b 73.5
🇨🇳 20 DeepSeek: DeepSeek R1 Distill Llama 8B深度求索 73.25
🇺🇸 21 Meta Llama: Llama 3.2 3B Instruct 72.5
🇺🇸 22 Apple: openelm-3b 72.44
🇺🇸 23 Microsoft: phi-4-mini-instruct 71.5
🇺🇸 24 Apple: openelm-1_1b-instruct 71.2
🇨🇳 25 Qwen: Qwen3.5 4B通义千问 70.75
🇦🇪 26 Technology Innovation Institute: falcon-h1-1.5b-deep-base 69.72
🇺🇸 27 Hugging Face Smol Models Research: smollm2-1.7b-instruct 68.7
🇦🇪 28 Technology Innovation Institute: falcon-h1-1.5b-base 66.76
🇩🇪 29 OpenGPT-X: Teuken 7B-instruct-v0.6 66
🇦🇪 30 Technology Innovation Institute: falcon-h1-1.5b-deep-instruct 65.54
🇺🇸 31 Apple: openelm-1_1b 64.81
🇨🇳 32 Qwen: qwen2-1.5b-instruct通义千问 64.5
🇷🇺 33 MWS AI: cotype-nano 64
🇺🇸 34 AMD: amd-olmo-1b 63.61
🇦🇪 35 Technology Innovation Institute: falcon-h1-1.5b-instruct 63.33
🇺🇸 36 Google: gemma-3-1b-pt 62.3
🇩🇪 37 OpenGPT-X: Teuken 7B-base-v0.6 61.9
🇺🇸 38 Apple: openelm-450m-instruct 59.34
🇨🇳 39 Qwen: Qwen3.5 2B通义千问 59
🇺🇸 40 LiquidAI: lfm-2.5-8b-a1b 58.25
🇺🇸 41 LiquidAI: LFM2.5 1.2B Instruct 57.75
🇨🇳 42 Qwen: qwen-1.8b通义千问 56.7
🇺🇸 43 Hugging Face Smol Models Research: SmolLM2 360M Instruct 54.5
🇺🇸 44 Apple: openelm-450m 53.97
🇺🇸 45 Apple: openelm-270m-instruct 52.07
🇺🇸 46 Hugging Face Smol Models Research: smollm-360m-instruct 51.8
🇩🇴 47 appvoid: arco-3 49.56
🇫🇷 48 Mistral AI: devstral-small-2505 48.5
🇺🇸 49 Apple: openelm-270m 46.71
🇨🇳 50 Qwen: Qwen3.5 0.8B通义千问 46.25
🇨🇳 51 OpenBMB: minicpm5-1b 45.5
🇷🇺 52 Sapbot: Grok 4 Distill SmolLM2 135M 43.75
🇺🇸 53 Hugging Face Smol Models Research: smollm2-135m 42.1
🇺🇸 54 NVIDIA Corporation: locateanything-3b 41.8
🇺🇸 55 LiquidAI: lfm-2.5-350m 41.25
🇨🇳 56 Qwen: qwen2.5-math-1.5b-instruct通义千问 41.25
🇺🇸 57 Hugging Face Smol Models Research: smollm2-135m-instruct 40.9
🇺🇸 58 LiquidAI: LFM2.5-230M 40
🇺🇸 59 Google: Gemma 3 270M Instruct 37.7
🇨🇳 60 Qwen: Qwen3 0.6B通义千问 37.62
❓ 61 pleias: baguettotron 36.75
🇫🇷 62 BigScience: bloom-560m 36.25
🇺🇸 63 Google: functiongemma-270m-it 35
🇦🇪 64 Technology Innovation Institute: Falcon H1 Tiny 90M Instruct 33.8
❓ 65 SupraLabs: Supra-50M BASE 31.8
🇺🇸 66 AMD: AMD-135m 30.48
❓ 67 raincandy-u: rain-v2 30
🇦🇪 68 Technology Innovation Institute: falcon-h1-tiny-coder-90m 29.75
❓ 69 SupraLabs: Supra-50M-Reasoning 29.16
❓ 70 raincandy-u: rain-100m 29
🇺🇸 71 OpenAI Community: GPT-2 28.92
❓ 72 SupraLabs: Supra-50M Instruct 27.94
❓ 73 SupraLabs: Supra-1.5 Instruct EXP 27.9
❓ 74 Doge Face: Doge 20M 27.3
❓ 75 Amir: tiny-llm 27
❓ 76 SupraLabs: Supra Mini v6 1M 26.74
🇷🇺 77 Sapbot: ToyLlama-50M 26.24
❓ 78 lh-tech-ai: quark-v2-0.5m 26.2
- 79 NON AI - НЕ ИИ: Random baseline - Случайный счёт 25