Information-seeking on GAIA
70.5Success RateOpenAI-o3
Evaluation Results
| Method | Links | |
|---|---|---|
| OpenAI-o32026.02 | 70.5 | |
| Claude-4-Sonnet2026.02 | 68.3 | |
| OpenAI DeepResearch2026.02 | 67.4 | |
| Qwen3-VL-30B-A3B-ICATools=Search & Fetch (snap.)2026.02 | 65 | |
| MiroThinker-32B-DPO-v0.2Tools=Search & Fetch (text)2026.02 | 64.1 | |
| Qwen3-VL-8B-ICATools=Search & Fetch (snap.)2026.02 | 61.2 | |
| Kimi-K2-Instruct-1TTools=Search & Fetch (text)2026.02 | 57.7 | |
| C-GRPOTools=Search & Fetch (text)2026.02 | 56.3 | |
| WebShaper-QwQ-32BTools=Search & Fetch (text)2026.02 | 53.3 | |
| WebSailor-32BTools=Search & Fetch (text)2026.02 | 53.2 | |
| ASearcher-Web-32BTools=Search & Fetch (text)2026.02 | 52.8 | |
| WebDancer-QwQ-32BTools=Search & Fetch (text)2026.02 | 51.5 | |
| WebExplorer-8BTools=Search & Fetch (text)2026.02 | 50 | |
| ECHO w/ Top-K retrievalBackbone=Qwen3-32B-Instruct2026.06 | 29.1 | |
| ECHOBackbone=Qwen3-32B-Instruct2026.06 | 29.1 | |
| GRPOBackbone=Qwen3-32B-Instruct2026.06 | 25.2 | |
| SUPOBackbone=Qwen3-32B-Instruct2026.06 | 25.2 | |
| ECHO w/o traceable CABackbone=Qwen3-32B-Instruct2026.06 | 25.2 | |
| ECHOBackbone=Qwen3-30B-A3B-Instruct2026.06 | 24.3 | |
| ECHO w/ Top-K retrieval & w/o turn summaryBackbone=Qwen3-32B-Instruct2026.06 | 23.3 | |
| ECHO w/o Traceable CA & Turn-level ISBackbone=Qwen3-32B-Instruct2026.06 | 23.3 | |
| GRPOBackbone=Qwen3-30B-A3B-Instruct2026.06 | 23.3 | |
| SUPOBackbone=Qwen3-30B-A3B-Instruct2026.06 | 23.3 |