ResearchBenchmarksCapture The Flag on CTF challenges crypto categoryFollow9,549CAI Total Time (s)CAI9,071.559,310.2759,5499,787.725Jan 21, 2026Evaluation ResultsMethodMethodLinksCAI Total Time (s)CAI Total Cost ($)Human Total Time (s)Human Total Cost ($)CAI/Human Time RatioCost Efficiency RatioCAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.019,5492.03——0.4729Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——4,48360——