Partial code vulnerability detection on PreciseBugs
90F1 ScoreSecCodePRM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SecCodePRMParameters=7B2026.02 | 90 | 93.94 | |
| GPT-oss-120B-lParameters=120B, Variant=l2026.02 | 16.92 | 80.92 | |
| GPT-oss-120B-mParameters=120B, Variant=m2026.02 | 13.35 | 74.56 | |
| QC2.5-7BParameters=7B2026.02 | 12.72 | 90.15 | |
| QC2.5-32BParameters=32B2026.02 | 12.66 | 89.84 | |
| QC3-30BParameters=30B2026.02 | 11.75 | 76.79 | |
| GPT-oss-120B-hParameters=120B, Variant=h2026.02 | 11.6 | 68.09 | |
| Llama4-17BParameters=17B2026.02 | 10.95 | 79.33 | |
| Gemma3-12BParameters=12B2026.02 | 10.03 | 87.39 | |
| Codestral-22BParameters=22B2026.02 | 5 | 56.65 |