Customer Support Interaction on τ-Bench Telecom Verified (test)
94Pass@1Gemini-3-flash
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemini-3-flashUser Simulator=GPT-5.22026.05 | 94 | |
| Gemini-3-flashUser Simulator=Gemini-3-flash2026.05 | 90 | |
| claude-sonnet-4.6User Simulator=Gemini-3-flash2026.05 | 81 | |
| deepseek-3.1User Simulator=GPT-5.22026.05 | 80 | |
| GPT-5.2User Simulator=GPT-5.22026.05 | 62 | |
| GPT-5.2User Simulator=Gemini-3-flash2026.05 | 55 | |
| deepseek-3.1User Simulator=Gemini-3-flash2026.05 | 53 | |
| Gemini-2.5-flashUser Simulator=GPT-5.22026.05 | 46 | |
| Qwen-32BUser Simulator=Gemini-3-flash2026.05 | 40 | |
| Gemini-2.5-flashUser Simulator=Gemini-3-flash2026.05 | 35 | |
| Qwen-32BUser Simulator=GPT-5.22026.05 | 28 |