Capture the Flag on CTF-Dojo
50.2Pass@1Full System
Evaluation results
| Method | Links | |
|---|---|---|
| Full SystemSystem Category=Ours2026.06 | 50.2 | |
| Multi agentSystem Category=Ours2026.06 | 47.9 | |
| AdaptiveSystem Category=Ours2026.06 | 46 | |
| A-EvolveSystem Category=Auto-harness baselines2026.06 | 45.2 | |
| GEPASystem Category=Auto-harness baselines2026.06 | 42.9 | |
| Meta HarnessSystem Category=Auto-harness baselines2026.06 | 41 | |
| OctoToolsSystem Category=Human2026.06 | 38.3 | |
| SonnetSystem Category=No evolution2026.06 | 37.2 | |
| SkillOSSystem Category=Auto-harness baselines2026.06 | 29.5 | |
| DeepSeekSystem Category=No evolution2026.06 | 26.1 | |
| Cont. HarnessSystem Category=Auto-harness baselines2026.06 | 25.7 | |
| KimiSystem Category=No evolution2026.06 | 24.5 | |
| HaikuSystem Category=No evolution2026.06 | 23.8 | |
| GLMSystem Category=No evolution2026.06 | 12.6 |