ResearchBenchmarksCapture The Flag on CTF challenges web categoryFollow558Time CAI (s)CAI530.1544.05558571.95Jan 21, 2026Evaluation ResultsMethodMethodLinksTime CAI (s)Cost CAI ($)Time Human (s)Cost Human ($)Time RatioCost RatioCAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.015581.78——56236Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——31,264421——