ResearchBenchmarksCapture The Flag on CTF challenges rev categoryFollow541CAI Time (s)CAI513.95527.475541554.525Jan 21, 2026Evaluation ResultsMethodMethodLinksCAI Time (s)CAI Cost ($)Human Time (s)Human Cost ($)Time Ratio (t_ratio)Cost Ratio (c_ratio)CAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.015410.83——7746,797Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——418,7895,642——