swebenchlite
7 models
Top 5 Models Performance
| Qwen: qwen3-coder-30b-a3b-instruct | ######################################## | 49.7 |
| DeepSeek: deepseek-v3 | ############################## | 36.7 |
| DeepSeek: deepseek-v3.2 | ######################### | 30.7 |
| Anthropic: claude-3-opus | ### | 4.33 |
| Anthropic: claude-2.0 | ## | 3 |
| Rank | Model | Score | |
|---|---|---|---|
| 🇨🇳 | 1 | Qwen: qwen3-coder-30b-a3b-instruct通义千问 | 49.7 |
| 🇨🇳 | 2 | DeepSeek: deepseek-v3深度求索 | 36.7 |
| 🇨🇳 | 3 | DeepSeek: deepseek-v3.2深度求索 | 30.7 |
| 🇺🇸 | 4 | Anthropic: claude-3-opus | 4.33 |
| 🇺🇸 | 5 | Anthropic: claude-2.0 | 3 |
| 🇺🇸 | 6 | OpenAI: gpt-4-turbo | 2.67 |
| 🇺🇸 | 7 | OpenAI: GPT-3.5 | 0.33 |