Partial code vulnerability detection on SVEN
50.17F1 ScoreSecCodePRM (7B)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SecCodePRM (7B)Parameters=7B2026.02 | 50.17 | 45.45 | 55.97 | 93.45 | — | |
| SecCodePRMParameters=7B2026.02 | 50.17 | — | — | 93.45 | — | |
| GPT-oss-120B-hParameters=120B, Variant=h2026.02 | 25.52 | 71.43 | 15.54 | 60.12 | 0.25 | |
| GPT-oss-120B-hParameters=120B, Variant=h2026.02 | 25.52 | — | — | 60.12 | — | |
| GPT-oss-120B-mParameters=120B, Variant=m2026.02 | 25.33 | 62.34 | 15.89 | 64.93 | 0 | |
| GPT-oss-120B-mParameters=120B, Variant=m2026.02 | 25.33 | — | — | 64.93 | — | |
| GPT-oss-120B-lParameters=120B, Variant=l2026.02 | 22.1 | 50.65 | 14.13 | 65.92 | 0 | |
| GPT-oss-120B-lParameters=120B, Variant=l2026.02 | 22.1 | — | — | 65.92 | — | |
| QC2.5-7BParameters=7B2026.02 | 17.59 | 32.41 | 12.07 | 81.5 | — | |
| QC2.5-7BParameters=7B2026.02 | 17.59 | — | — | 81.5 | — | |
| Gemma3-12BParameters=12B2026.02 | 16.81 | 26.32 | 12.35 | 73.28 | 8.18 | |
| Gemma3-12BParameters=12B2026.02 | 16.81 | — | — | 73.28 | — | |
| QC2.5-32BParameters=32B2026.02 | 16.56 | 22.32 | 13.16 | 87.27 | — | |
| QC2.5-32BParameters=32B2026.02 | 16.56 | — | — | 87.27 | — | |
| Codestral-22BParameters=22B2026.02 | 13.57 | 21.43 | 9.93 | 71.45 | 17.1 | |
| Codestral-22BParameters=22B2026.02 | 13.57 | — | — | 71.45 | — | |
| QC3-30BParameters=30B2026.02 | 8.55 | 6.94 | 11.11 | 86.09 | 4.71 | |
| QC3-30BParameters=30B2026.02 | 8.55 | — | — | 86.09 | — | |
| Llama4-17BParameters=17B2026.02 | 0 | 0 | 0 | 87.78 | 82.54 | |
| Llama4-17BParameters=17B2026.02 | 0 | — | — | 87.78 | — |