Vulnerability Detection on PrimeVul Paired (full)
93.66PC ScoreSecCodePRM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SecCodePRM2026.02 | 93.66 | 0 | 6.34 | 0 | |
| RANDOM GUESS2026.02 | 22.7 | 26.24 | 26.42 | 24.65 | |
| GPT-4Evaluation protocol=CoT2026.02 | 12.94 | 54.26 | 24.47 | 8.33 | |
| GPT-3.5Evaluation protocol=CoT2026.02 | 6.21 | 4.79 | 83.51 | 5.5 | |
| GPT-3.5Evaluation protocol=Two-shot2026.02 | 5.67 | 13.83 | 77.84 | 2.66 | |
| GPT-4Evaluation protocol=Two-shot2026.02 | 5.14 | 71.63 | 21.45 | 1.77 | |
| Qwen2.5-PRM-7B2026.02 | 3.41 | 82.07 | 11.34 | 3.17 | |
| CodeGen2.52026.02 | 3.01 | 10.82 | 84.22 | 1.95 | |
| StarCoder22026.02 | 2.3 | 8.16 | 88.3 | 1.24 | |
| UniXcoder2026.02 | 1.6 | 12.06 | 85.11 | 1.24 | |
| GPT-3.5Evaluation protocol=Fine-tune2026.02 | 1.24 | 5.32 | 90.96 | 2.48 | |
| CodeT52026.02 | 1.06 | 12.94 | 84.75 | 1.24 | |
| CodeBERT2026.02 | 0.35 | 1.95 | 86.17 | 0.71 |