ResearchBenchmarksCapture The Flag on CTF challenges robotics categoryFollow408CAI Time (s)CAI387.6397.8408418.2Jan 21, 2026Evaluation ResultsMethodMethodLinksCAI Time (s)CAI Cost ($)Human Time (s)Human Cost ($)Time RatioCost RatioCAIcost_basis=API expense...cost_basis=API expenses, aggregation=Sum of average completion times2026.014086.6——741617Humanhourly_labor_rate=$48....hourly_labor_rate=$48.54, aggregation=Sum of average completion times2026.01——302,4004,074——