HellaSwag
79 models
HellaSwag — a benchmark by the University of Washington and Allen AI (Rowan Zellers et al., ACL 2019). Given an event description, the model must pick the most likely follow-up from 4 choices — testing commonsense reasoning. Built via Adversarial Filtering: wrong answers that are ridiculous to humans but plausible to models are iteratively generated. Humans score >95%, SOTA models originally scored <48%. Metric: accuracy.
Top 5 Models Performance
| Anthropic: claude-3-opus | ######################################## | 95.4 |
| NON AI - НЕ ИИ: Human baseline - Человеческий результат | ######################################## | 95 |
| Xiaomi: MiMo-V2.5 Pro | ###################################### | 89.8 |
| Sber: gigachat3.5-432b-a28b-base | ###################################### | 89.47 |
| Google: Gemma 3 27B Pretrained | #################################### | 85.6 |