Customer Support Interaction on τc-Bench Telecom Ours (test)
72Pass@1claude-sonnet-4.6
Evaluation Results
| Method | Links | |
|---|---|---|
| claude-sonnet-4.6User Simulator=Gemini-3-flash2026.05 | 72 | |
| Gemini-3-flashUser Simulator=GPT-5.22026.05 | 61 | |
| deepseek-3.1User Simulator=GPT-5.22026.05 | 61 | |
| Gemini-3-flashUser Simulator=Gemini-3-flash2026.05 | 55 | |
| deepseek-3.1User Simulator=Gemini-3-flash2026.05 | 48 | |
| GPT-5.2User Simulator=GPT-5.22026.05 | 47 | |
| GPT-5.2User Simulator=Gemini-3-flash2026.05 | 44 | |
| Qwen-32BUser Simulator=Gemini-3-flash2026.05 | 38 | |
| Gemini-2.5-flashUser Simulator=GPT-5.22026.05 | 33 | |
| Qwen-32BUser Simulator=GPT-5.22026.05 | 31 | |
| Gemini-2.5-flashUser Simulator=Gemini-3-flash2026.05 | 27 |