Vulnerability Detection
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
97Precision
42
Apr 30, 2026
59Top 1 Hit Rate (cs)
42
Feb 26, 2026
48.3Precision
42
Feb 26, 2026
292True Positives (TP)
39
Apr 14, 2026
68.74F1 Score
38
Feb 26, 2026
24.91Precision
35
Apr 23, 2026
23TP
30
May 26, 2026
85True Positives (TP)
30
May 26, 2026
19.03Precision
30
Feb 26, 2026
1,068CASTLE Score
29
Mar 31, 2026
25.93Precision
24
Feb 26, 2026
11.64Precision
24
Feb 26, 2026
67.93F1 Score
24
Feb 27, 2026
275Pair-Correct Count
22
May 12, 2026
98.29Precision
20
Jun 4, 2026
2Time (hours)
19
Feb 26, 2026
22.6P-Pass@1
18
May 28, 2026
60.27Pass@1
18
Feb 26, 2026
106True Positives
18
Feb 26, 2026
65.8Accuracy
18
Feb 26, 2026
89.5F1 Score
14
Feb 26, 2026
93.66PC Score
13
Feb 27, 2026
51Affected Files Count
12
Jun 4, 2026
97.76F1 Score
12
Apr 30, 2026
89.9Accuracy
12
Apr 30, 2026