Agentic Tasks on Tau2 Retail
78.1ScoreGPT-5.1 (Medium)
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-5.1 (Medium)User-simulator=GPT-4.12026.01 | 78.1 | |
| gpt-oss-120bNumber of Parameters=117B, Optimization Level=high2026.01 | 76.5 | |
| GPT-5.1 (Medium)User-simulator=GPT-5.12026.01 | 73.6 | |
| GLM-4.5-AirNumber of Parameters=110B2026.01 | 71.9 | |
| HyperCLOVA X 32B ThinkUser-simulator=GPT-4.12026.01 | 71.6 | |
| gpt-oss-120bNumber of Parameters=117B, Optimization Level=medium2026.01 | 68.4 | |
| HyperCLOVA X 32B ThinkUser-simulator=GPT-5.12026.01 | 67.2 | |
| Solar OpenNumber of Parameters=102B2026.01 | 59.3 | |
| Qwen3 235B-A22BUser-simulator=GPT-5.12026.01 | 58.4 | |
| Qwen3 235B-A22BUser-simulator=GPT-4.12026.01 | 51.4 |