Vulnerability Detection on ProSec
77.39PrecisionQwen2.5-Coder-7B-Inst
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5-Coder-7B-InstSource Type=Open-Source, Model Scale=7B, Instruction Tuned=true2026.02 | 77.39 | 21.87 | 34.1 | |
| Qwen3-14BSource Type=Open-Source, Model Scale=14B2026.02 | 63.32 | 75.76 | 68.99 | |
| Qwen3-8BSource Type=Open-Source, Model Scale=8B2026.02 | 62.71 | 76.87 | 69.07 | |
| Qwen2.5-Coder-14B-InstSource Type=Open-Source, Model Scale=14B, Instruction Tuned=true2026.02 | 61.95 | 78.73 | 69.34 | |
| GPT-4.1Source Type=Closed-Source2026.02 | 58.57 | 86.62 | 69.89 | |
| SecCoderX RM 8BSource Type=Open-Source, Model Scale=8B2026.02 | 56.64 | 89.17 | 69.28 | |
| R2Vul 7BSource Type=Open-Source, Model Scale=7B2026.02 | 51.72 | 86.32 | 64.68 | |
| Gemini-2.5-FlashSource Type=Closed-Source2026.02 | 50.36 | 95.2 | 65.88 |