Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

WikiText-2 (-ppl)

56 models

WikiText-2 Perplexity — measures how well a model predicts Wikipedia-style text. Lower perplexity (PPL) means the model has learned natural language patterns better. Note: models optimized for reasoning, coding, or instruction-following typically show higher PPL due to domain shift — this is expected, not a bug.

Top 5 Models Performance

Yandex: YandexGPT Lite 5 ################################## -7.0947
Qwen: qwen3.5-9b-base ################################### -7.349
T-Tech: t-lite-it-1.0 ##################################### -7.66
Qwen: Qwen3.5 9B ######################################## -8.324
Hugging Face Smol Models Research: smollm3-3b-base ######################################## -8.3513
– 970 – 1.1T
– 2019 – 2026
Rank Model Score
🇷🇺 1 Yandex: YandexGPT Lite 5Яндекс -7.0947
🇨🇳 2 Qwen: qwen3.5-9b-base通义千问 -7.349
🇷🇺 3 T-Tech: t-lite-it-1.0 -7.66
🇨🇳 4 Qwen: Qwen3.5 9B通义千问 -8.324
🇺🇸 5 Hugging Face Smol Models Research: smollm3-3b-base -8.3513
🇫🇷 6 Mistral AI: ministral-3-3b-instruct-2512 -9.0007
❓ 7 Houssem Fatnasssi: kilma-v1-base -9.0167
🇺🇸 8 Hugging Face Smol Models Research: smollm3-3b -9.7604
❓ 9 LocoreMind: locooperator-4b -10.0479
🇨🇳 10 Qwen: Qwen3.5 4B通义千问 -10.0705
🇺🇸 11 IBM Granite: granite-4.1-3b -10.58
🇨🇳 12 Qwen: qwen2-1.5b-instruct通义千问 -10.65
🇺🇸 13 Microsoft: phi-4-mini-instruct -10.8412
🇺🇸 14 Meta Llama: Llama 3.2 3B Instruct -10.8477
🇺🇸 15 Google: gemma-3-1b-pt -11.9524
🇺🇸 16 Hugging Face Smol Models Research: smollm2-360m -12.1571
🇨🇳 17 Qwen: Qwen3.5 2B通义千问 -13.5192
🇷🇺 18 Sapbot: Gemma 3n 4B Distill SmolLM2 360M Instruct -13.5953
🇺🇸 19 Hugging Face Smol Models Research: SmolLM2 360M Instruct -13.6027
🇨🇳 20 Qwen: qwen2.5-0.5b通义千问 -14.3732
🇨🇳 21 DeepSeek: DeepSeek R1 Distill Llama 8B深度求索 -14.446
🇨🇳 22 Qwen: qwen3-0.6b-base通义千问 -14.639
🇺🇸 23 Google: Gemma 3 4B Instruct -16.7015
🇨🇳 24 OpenBMB: minicpm-o-4_5 -17.1023
🇨🇳 25 Qwen: qwen2.5-0.5b-instruct通义千问 -17.493
🇷🇺 26 MWS AI: cotype-nano -17.54
🇺🇸 27 AMD: AMD-135m -18.103
🇷🇺 28 Sapbot: Grok 4 Distill SmolLM2 135M -19.203
🇨🇳 29 Qwen: Qwen3.5 0.8B通义千问 -20.5747
🇦🇪 30 Technology Innovation Institute: falcon-h1-tiny-coder-90m -20.8404
🇺🇸 31 LiquidAI: LFM2.5 1.2B Instruct -21.9587
🇺🇸 32 Google: Gemma 4 E4B -23.1498
🇷🇺 33 Sapbot: Gemma 4 31B Instruct Distill Qwen3 0.6B LoRA -23.5958
🇨🇳 34 Qwen: Qwen3 0.6B通义千问 -24.0627
🇨🇳 35 OpenBMB: minicpm5-1b -28.7973
🇺🇸 36 OpenAI Community: GPT-2 -28.8355
🇺🇸 37 LiquidAI: lfm-2.5-8b-a1b -31.9073
🇺🇸 38 LiquidAI: LFM2.5-230M -37.24
🇫🇷 39 BigScience: bloom-560m -38.0031
❓ 40 pleias: baguettotron -47.2352
🇺🇸 41 LiquidAI: lfm-2.5-350m -47.55099
🇩🇴 42 appvoid: carbono-001 -51.4911
🇺🇸 43 Google: Gemma 3 270M Instruct -65.6058
🇺🇸 44 Google: Gemma 4 E4B Instruct -68.255
🇨🇳 45 Tencent: youtu-llm-2b腾讯控股有限公司 -80.4648
🇨🇳 46 Qwen: qwen2.5-math-1.5b-instruct通义千问 -86.8916
❓ 47 raincandy-u: rain-100m -107.9683
🇺🇸 48 Google: functiongemma-270m-it -109.8192
❓ 49 SupraLabs: Supra-1.5 Instruct EXP -127.28
🇺🇸 50 OpenAI: gpt-oss-20b -142.8194
🇺🇸 51 NVIDIA Corporation: locateanything-3b -145.45
❓ 52 Amir: tiny-llm -162.4178
❓ 53 SupraLabs: Supra-50M-Reasoning -166.27
🇦🇪 54 Technology Innovation Institute: Falcon H1 Tiny 90M Instruct -334.54
🇷🇺 55 Sapbot: ToyLlama-50M -405.2885
🇫🇷 56 Mistral AI: devstral-small-2505 -446.6744