ResearchBenchmarksSuccess Prediction on SWE-bench Verified (held-out agent data)Follow0.949AUC-ROCOracle0.840840.868920.8970.92508Apr 1, 2026Evaluation ResultsMethodMethodLinksAUC-ROCOracle2026.040.949IRT-Agent2026.040.936Baseline2026.040.845