Web Agent Task Completion on Browsecomp
51.5AccuracyOpenAI DeepResearch
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| OpenAI DeepResearchType=Proprietary System2026.06 | 51.5 | — | — | |
| OpenAI o3Type=Proprietary System2026.06 | 49.7 | — | — | |
| SlimSearcher (SFT+RL)Backbone Policy=Tongyi-DeepResearch, Optimization Strategy=SFT+RL2026.06 | 44.7 | 47.63 | 11,093 | |
| SlimSearcher (SFT)Backbone Policy=Tongyi-DeepResearch, Optimization Strategy=SFT2026.06 | 42.8 | 61.28 | 11,522 | |
| Tongyi-DeepResearch2026.06 | 41 | 63.7 | 12,014 | |
| WebLeaperType=Open-weights Agent2026.06 | 38.8 | 60.07 | 10,894 | |
| Prompt ControlBackbone Policy=Tongyi-DeepResearch, Optimization Strategy=Prompt Control2026.06 | 37.3 | 62.8 | 12,222 | |
| SlimSearcher (SFT+RL)Backbone Policy=Qwen3-30B-A3B-Instruct-2507, Optimization Strategy=SFT+RL2026.06 | 32.8 | 47.22 | 10,883 | |
| SlimSearcher (SFT)Backbone Policy=Qwen3-30B-A3B-Instruct-2507, Optimization Strategy=SFT2026.06 | 30.9 | 65.53 | 12,185 | |
| WebExplorerType=Open-weights Agent2026.06 | 13.7 | 29.43 | 6,289 | |
| Claude-4-SonnetType=Proprietary System2026.06 | 12.2 | — | — | |
| Kimi-K2-Instruct-0905Type=Open-weights Agent2026.06 | 9.4 | 16.65 | 3,426 | |
| Qwen3-235B-A22B-InstructType=Open-weights Agent2026.06 | 4.6 | 13.7 | 1,837 | |
| DeepSeek-V3Type=Open-weights Agent2026.06 | 3.8 | 4.78 | 1,317 | |
| Qwen3-30B-A3B-Instruct-2507Type=Open-weights Agent, Unified Environment=true2026.06 | 2.9 | 25.8 | 1,683 |