Partial code vulnerability detection on ReposVul
23.79F1 ScoreSecCodePRM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SecCodePRMParameters=7B2026.02 | 23.79 | 99.33 | |
| GPT-oss-120B-hParameters=120B, Variant=h2026.02 | 0.51 | 87.15 | |
| GPT-oss-120B-lParameters=120B, Variant=l2026.02 | 0.41 | 93.59 | |
| GPT-oss-120B-mParameters=120B, Variant=m2026.02 | 0.39 | 89.9 | |
| QC2.5-7BParameters=7B2026.02 | 0.35 | 91.77 | |
| QC2.5-32BParameters=32B2026.02 | 0 | 98.21 | |
| QC3-30BParameters=30B2026.02 | 0 | 92.99 | |
| Llama4-17BParameters=17B2026.02 | 0 | 87.78 | |
| Codestral-22BParameters=22B2026.02 | 0 | 55.34 | |
| Gemma3-12BParameters=12B2026.02 | 0 | 95.85 |