ResearchBenchmarksCapture The Flag on CTF challenges all categoriesFollow112,506CAI Total Time (s)CAI106,880.7109,693.35112,506115,318.65Jan 21, 2026Evaluation ResultsMethodMethodLinksCAI Total Time (s)CAI Total Cost ($)Human Total Time (s)Human Total Cost ($)Time Ratio (t_ratio)Cost Ratio (c_ratio)CAIcost_basis=API expense...cost_basis=API expenses, aggregation=Cumulative sum across all categories2026.01112,506109——11156Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Cumulative sum across all categories2026.01——1,278,06817,218——