ResearchBenchmarksCapture The Flag on CTF challenges misc categoryFollow1,650Total Time (CAI) (s)CAI1,567.51,608.751,6501,691.25Jan 21, 2026Evaluation ResultsMethodMethodLinksTotal Time (CAI) (s)Total Cost (CAI) ($)Total Time (Human) (s)Total Cost (Human) ($)Time Ratio (t_ratio)Cost Ratio (c_ratio)CAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.011,6503.04——23169Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——38,364516——