ResearchBenchmarksCapture The Flag on CTF challenges pwn categoryFollow99,368Total Time - CAI (s)CAI94,399.696,883.899,368101,852.2Jan 21, 2026Evaluation ResultsMethodMethodLinksTotal Time - CAI (s)Total Cost - CAI ($)Total Time - Human (s)Total Cost - Human ($)Time Ratio (t_ratio)Cost Ratio (c_ratio)CAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.0199,36893——7711Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——77,4071,042——