Web Agent Task Completion on GAIA
70.9AccuracySlimSearcher (SFT+RL)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SlimSearcher (SFT+RL)Backbone Policy=Tongyi-DeepResearch, Optimization Strategy=SFT+RL2026.06 | 70.9 | 10.61 | 4,915 | |
| WebLeaperType=Open-weights Agent2026.06 | 70.2 | 16.65 | 5,045 | |
| SlimSearcher (SFT+RL)Backbone Policy=Qwen3-30B-A3B-Instruct-2507, Optimization Strategy=SFT+RL2026.06 | 69.9 | 20.13 | 7,237 | |
| Claude-4-SonnetType=Proprietary System2026.06 | 68.3 | — | — | |
| Tongyi-DeepResearch2026.06 | 68.2 | 20.56 | 7,378 | |
| OpenAI DeepResearchType=Proprietary System2026.06 | 67.4 | — | — | |
| SlimSearcher (SFT)Backbone Policy=Qwen3-30B-A3B-Instruct-2507, Optimization Strategy=SFT2026.06 | 66.5 | 24.46 | 7,299 | |
| Prompt ControlBackbone Policy=Tongyi-DeepResearch, Optimization Strategy=Prompt Control2026.06 | 66.3 | 18.7 | 6,752 | |
| SlimSearcher (SFT)Backbone Policy=Tongyi-DeepResearch, Optimization Strategy=SFT2026.06 | 66 | 21.79 | 6,412 | |
| Kimi-K2-Instruct-0905Type=Open-weights Agent2026.06 | 46.9 | 6.45 | 1,281 | |
| Qwen3-235B-A22B-InstructType=Open-weights Agent2026.06 | 45.6 | 7.14 | 1,128 | |
| DeepSeek-V3Type=Open-weights Agent2026.06 | 37.3 | 3.2 | 994 | |
| WebExplorerType=Open-weights Agent2026.06 | 37.2 | 12.88 | 3,560 | |
| Qwen3-30B-A3B-Instruct-2507Type=Open-weights Agent, Unified Environment=true2026.06 | 33.9 | 11.63 | 986 |