List your company

Interactive Agent Task on TRIP-Bench (Hard LIT)

4,400Loose SuccessGPT-5.2
-1761,0122,2003,388Feb 2, 2026

Evaluation results

MethodLinks
GPT-5.2thinking mode=w/ thinking2026.024,4001,400
DeepSeek-V3.2thinking mode=w/ thinking2026.023,600200
Claude-Sonnet-4.5thinking mode=w/ thinking2026.022,8000
DeepSeek-V3.2thinking mode=w/o thinking2026.021,600200
Gemini-3-Prothinking mode=w/ thinking2026.021,6000
Gemini-3-Prothinking mode=w/o thinking2026.021,2000
GPT-5.2thinking mode=w/o thinking2026.021,0000
Claude-Sonnet-4.5thinking mode=w/o thinking2026.021,0000
GLM-4.7thinking mode=w/ thinking2026.021,0000
Gemini-3-Flashthinking mode=w/ thinking2026.021,0000
Gemini-3-Flashthinking mode=w/o thinking2026.028000
GLM-4.7thinking mode=w/o thinking2026.026000
Gemini-3-Flashthinking mode=w/ thinking2026.02260
DeepSeek-V3.2thinking mode=w/ thinking2026.02260
Claude-Sonnet-4.5thinking mode=w/ thinking2026.02220
GPT-5.2thinking mode=w/ thinking2026.02200
Gemini-3-Prothinking mode=w/ thinking2026.02180
Gemini-3-Flashthinking mode=w/o thinking2026.02160
Gemini-3-Prothinking mode=w/o thinking2026.02120
Claude-Sonnet-4.5thinking mode=w/o thinking2026.02100
GPT-5.2thinking mode=w/o thinking2026.0280
Qwen3-235B-A22B-Instruct-2507thinking mode=w/o thinking2026.0220
DeepSeek-V3.2thinking mode=w/o thinking2026.0220
Kimi-K2-0905-Previewthinking mode=w/o thinking2026.0200
Qwen3-235B-A22B-Instruct-2507thinking mode=w/o thinking2026.0200
Qwen3-235B-A22B-Thinking-2507thinking mode=w/ thinking2026.0200
Kimi-K2-Thinkingthinking mode=w/ thinking2026.0200
Kimi-K2-0905-Previewthinking mode=w/o thinking2026.0200
GLM-4.7thinking mode=w/o thinking2026.0200
Qwen3-235B-A22B-Thinking-2507thinking mode=w/ thinking2026.0200
Kimi-K2-Thinkingthinking mode=w/ thinking2026.0200
GLM-4.7thinking mode=w/ thinking2026.0200