Note: Overall leaderboard rankings may not reflect true model quality — individual benchmarks give a clearer picture. ARC-Challenge MMLU GPQA GSM8K Artificial Analysis Intelligence Index v4.1
← Back to leaderboard

TauBench V2 (Average)

21 models

τ²-bench (Tau Squared Bench) is an extended version of τ-bench designed to evaluate AI agents in dynamic conversational tool‑use environments. Tasks are framed as customer‑service scenarios across three domains: airline, retail, and telecom. Both the agent and a simulated user can call APIs to read and write to a shared world state. The key metric—TauBench V2 (Average)—reports the average task completion rate across the three domains, measuring an agent’s reliability in following business policies and effectively using tools without access to vision or diffusion models.

Top 5 Models Performance

Google: Gemini 3.1 Pro Preview ######################################## 99.3
SpaceXAI: Grok 4.3 ####################################### 98
Anthropic: Claude Opus 4.8 ###################################### 94
xhtoken: spark-x2.6-4b ################################### 86.9
Intern Language Models: intern-s1-pro ################################# 80.9
– 970 – 1.1T
– 2019 – 2026
Rank Model Score
🇺🇸 1 Google: Gemini 3.1 Pro Preview 99.3
🇺🇸 2 SpaceXAI: Grok 4.3 98
🇺🇸 3 Anthropic: Claude Opus 4.8 94
❓ 4 xhtoken: spark-x2.6-4b 86.9
🇨🇳 5 Intern Language Models: intern-s1-pro 80.9
🇺🇸 6 Google: Gemma 4 31B Instruct 76.9
❓ 7 xhtoken: spark-x2.5-4b 75.1
❓ 8 Prism ML: ternary-bonsai-27b 73.61
🇰🇷 9 LG AI Research: k-exaone-236b-a23b주식회사 엘지 73.2
🇨🇳 10 Z.ai: GLM 5.1北京智谱华章科技有限公司 70.6
🇺🇸 11 Google: Gemma 4 12B Instruct 69
🇷🇺 12 Sber: gigachat3.5-432b-a28bСбер 68.71
❓ 13 xhtoken: spark-x2.5-1.7b 65.3
🇺🇸 14 Google: diffusiongemma-26b-a4b-it 56.2
🇺🇸 15 NVIDIA Corporation: nvidia-nemotron-3.5-bolt-e4b 55.1
🇺🇸 16 NVIDIA Corporation: nvidia-nemotron-3-nano-30b-a3b 49
❓ 17 zyphra: zaya1-8b 43.12
🇺🇸 18 Google: Gemma 4 E4B Instruct 42.2
🇺🇸 19 LiquidAI: LFM2.5-230M 16.98
🇨🇳 20 Tencent: youtu-llm-2b腾讯控股有限公司 15
🇨🇳 21 Qwen: Qwen3 4B通义千问 10.9