WikiText-2 (-ppl)
56 models
WikiText-2 Perplexity — measures how well a model predicts Wikipedia-style text. Lower perplexity (PPL) means the model has learned natural language patterns better. Note: models optimized for reasoning, coding, or instruction-following typically show higher PPL due to domain shift — this is expected, not a bug.
Top 5 Models Performance
| Yandex: YandexGPT Lite 5 | ################################## | -7.0947 |
| Qwen: qwen3.5-9b-base | ################################### | -7.349 |
| T-Tech: t-lite-it-1.0 | ##################################### | -7.66 |
| Qwen: Qwen3.5 9B | ######################################## | -8.324 |
| Hugging Face Smol Models Research: smollm3-3b-base | ######################################## | -8.3513 |