Interactive Agent Task on TRIP-Bench Mid
55Loose Success RateGPT-5.2
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-5.2thinking mode=w/ thinking2026.02 | 55 | 13 | |
| DeepSeek-V3.2thinking mode=w/ thinking2026.02 | 41 | 9 | |
| Claude-Sonnet-4.5thinking mode=w/ thinking2026.02 | 31 | 6 | |
| GLM-4.7thinking mode=w/ thinking2026.02 | 29 | 0 | |
| Gemini-3-Flashthinking mode=w/ thinking2026.02 | 25 | 0 | |
| GLM-4.7thinking mode=w/o thinking2026.02 | 20 | 0 | |
| DeepSeek-V3.2thinking mode=w/o thinking2026.02 | 20 | 3 | |
| Claude-Sonnet-4.5thinking mode=w/o thinking2026.02 | 18 | 0 | |
| Gemini-3-Prothinking mode=w/ thinking2026.02 | 16 | 0 | |
| GPT-5.2thinking mode=w/o thinking2026.02 | 14 | 0 | |
| Gemini-3-Flashthinking mode=w/o thinking2026.02 | 11 | 0 | |
| Gemini-3-Prothinking mode=w/o thinking2026.02 | 9 | 0 | |
| Kimi-K2-Thinkingthinking mode=w/ thinking2026.02 | 8 | 4 | |
| Qwen3-235B-A22B-Instruct-2507thinking mode=w/o thinking2026.02 | 5 | 0 | |
| Kimi-K2-0905-Previewthinking mode=w/o thinking2026.02 | 0 | 0 | |
| Qwen3-235B-A22B-Thinking-2507thinking mode=w/ thinking2026.02 | 0 | 0 |