Web-retrieval Task Completion on FutureX
49.5Pass@1Multi agent
Evaluation Results
| Method | Links | |
|---|---|---|
| Multi agentSystem Category=Ours2026.06 | 49.5 | |
| A-EvolveSystem Category=Auto-harness baselines2026.06 | 47.5 | |
| Full SystemSystem Category=Ours2026.06 | 47.3 | |
| AdaptiveSystem Category=Ours2026.06 | 44.1 | |
| Cont. HarnessSystem Category=Auto-harness baselines2026.06 | 31.8 | |
| DeepSeekSystem Category=No evolution2026.06 | 31.2 | |
| SonnetSystem Category=No evolution2026.06 | 31 | |
| HaikuSystem Category=No evolution2026.06 | 31 | |
| GLMSystem Category=No evolution2026.06 | 30.8 | |
| SkillOSSystem Category=Auto-harness baselines2026.06 | 29.8 | |
| Meta HarnessSystem Category=Auto-harness baselines2026.06 | 29.4 | |
| GEPASystem Category=Auto-harness baselines2026.06 | 28.2 | |
| KimiSystem Category=No evolution2026.06 | 27.8 | |
| OctoToolsSystem Category=Human2026.06 | 25.6 |