Long-Horizon User-Centric Interaction on τ2-Bench
46.9Telecom Success RateGemini-3-Flash
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-3-FlashType=Prompting, Backbone=Closed-Source Model2026.02 | 46.9 | 61.9 | 55.8 | |
| GPT-4.1Type=Prompting, Backbone=Closed-Source Model2026.02 | 38.8 | 54.4 | 40 | |
| InfoPO (Ours)Type=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 18.1 | 18.8 | 16.3 | |
| RAGENType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 17.5 | 17.5 | 15 | |
| InfoPO w/o stdType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 16.9 | 16.2 | 12.5 | |
| Search-R1Type=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 15.6 | 15 | 10 | |
| InfoPO (Ours)Type=RL Training, Backbone=Qwen3-4B2026.02 | 15.6 | 24.4 | 10 | |
| InfoPO w/o GateType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 15 | 15.6 | 10 | |
| Qwen2.5Type=Prompting, Backbone=Qwen2.5-7B-Instruct2026.02 | 14.4 | 13.1 | 7.5 | |
| InfoPO w/o stdType=RL Training, Backbone=Qwen3-4B2026.02 | 14.2 | 21.5 | 8.8 | |
| ReflexionType=Prompting, Backbone=Qwen2.5-7B-Instruct2026.02 | 13.8 | 13.1 | 7.5 | |
| UserRLType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 13.8 | 16.9 | 7.5 | |
| RAGENType=RL Training, Backbone=Qwen3-4B2026.02 | 13.7 | 23.1 | 8.8 | |
| ReActType=Prompting, Backbone=Qwen2.5-7B-Instruct2026.02 | 13.1 | 13.8 | 10 | |
| InfoPO w/o GateType=RL Training, Backbone=Qwen3-4B2026.02 | 13.1 | 19.8 | 7.5 | |
| Search-R1Type=RL Training, Backbone=Qwen3-4B2026.02 | 11.8 | 23.4 | 8.8 | |
| GPT-4o-miniType=Prompting, Backbone=Closed-Source Model2026.02 | 11.3 | 40 | 17.5 | |
| InfoPO w/o RextType=RL Training, Backbone=Qwen2.5-7B-Instruct2026.02 | 11.2 | 12.5 | 8.8 | |
| Qwen3Type=Prompting, Backbone=Qwen3-4B2026.02 | 10.6 | 22.5 | 6.2 | |
| ReflexionType=Prompting, Backbone=Qwen3-4B2026.02 | 10 | 20 | 7.5 | |
| UserRLType=RL Training, Backbone=Qwen3-4B2026.02 | 10 | 16.3 | 7.5 | |
| InfoPO w/o RextType=RL Training, Backbone=Qwen3-4B2026.02 | 9.5 | 15.2 | 5.5 | |
| ReActType=Prompting, Backbone=Qwen3-4B2026.02 | 9.4 | 22.5 | 8.8 |