Vulnerability Detection on SVEN (test)
63.72AccuracyReVD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ReVDBackbone=Qwen2.5-Coder-7B-Instruct2025.06 | 63.72 | 69.49 | 27.44 | |
| ReVDBackbone=Llama-3.1-8B-Instruct2025.06 | 61.82 | 60.7 | 23.65 | |
| ReVDBackbone=StarCoder2-7B2025.06 | 57.34 | 53.96 | 14.68 | |
| Qwen2.5-Coder-7B-InstructType=COT2025.06 | 52.31 | 27.63 | 4.62 | |
| UniXCoderType=SFT2025.06 | 51.9 | 43.45 | 3.8 | |
| LineVulType=SFT2025.06 | 51.9 | 40.4 | 3.8 | |
| CodeBERTType=SFT2025.06 | 51.77 | 49.79 | 3.53 | |
| Qwen2.5-32b-Coder-InstructType=COT2025.06 | 51.36 | 29.25 | 2.72 | |
| GPT-4Type=COT2025.06 | 51.36 | 56.76 | 2.72 | |
| Llama3.1-70B-InstructType=COT2025.06 | 50 | 31.34 | 0 | |
| Llama-3.1-8B-InstructType=COT2025.06 | 50 | 46.82 | 0 | |
| StarCoder2-7BType=COT2025.06 | 50 | 0 | 0 |