Agentic Reasoning on TauBench V3
85.8Airline AccuracyKimi-K2.6
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Kimi-K2.6Parameter Count=1T-A32B2026.06 | 85.8 | 82.9 | 97.8 | 23.1 | 72.4 | |
| GLM-5.1Parameter Count=744B-A40B2026.06 | 85 | 84.1 | 96.9 | 12.8 | 69.7 | |
| Nemotron 3 UltraParameter Count=550B-A55B2026.06 | 81.5 | 86.4 | 92.9 | 22.6 | 70.9 | |
| DS-v4-ProParameter Count=1.6T-A49B2026.06 | 80.8 | 88.9 | 96.3 | 25.9 | 73.2 | |
| DS-v4-FlashParameter Count=284B-A13B2026.06 | 80.8 | 89.1 | 98.3 | 26.7 | 73.7 | |
| Qwen-3.5Parameter Count=397B-17B2026.06 | 76.5 | 88.5 | 98 | 20.9 | 71 | |
| MiniMax-2.7Parameter Count=230B-A10B2026.06 | 75.3 | 84.9 | 89.6 | 14.6 | 66.1 |