Vulnerability Detection on SVEN
89.5F1 ScoreLARA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LARAFramework Type=LLM-Guided Static Analysis2026.02 | 89.5 | — | 0.818 | 0.988 | |
| GPT-4.1Source Type=Closed-Source2026.02 | 0.7094 | — | 0.6209 | 0.8272 | |
| LLMxCPGFramework Type=LLM-Guided Static Analysis2026.02 | 0.705 | 0.602 | 0.559 | 0.9534 | |
| SecCoderX RM 8BSource Type=Open-Source, Model Scale=8B2026.02 | 0.6855 | — | 0.5791 | 0.8398 | |
| Qwen3-14BSource Type=Open-Source, Model Scale=14B2026.02 | 0.667 | — | 0.7018 | 0.6355 | |
| Gemini-2.5-FlashSource Type=Closed-Source2026.02 | 0.6622 | — | 0.5247 | 0.8974 | |
| VulAgentFramework Type=Multi-Agent Frameworks, Dataset Partition=SVEN2026.02 | 0.656 | 0.602 | — | — | |
| Qwen3-8BSource Type=Open-Source, Model Scale=8B2026.02 | 0.6511 | — | 0.6608 | 0.6418 | |
| R2Vul 7BSource Type=Open-Source, Model Scale=7B2026.02 | 0.6356 | — | 0.5127 | 0.8362 | |
| ReGVDFramework Type=Pattern-Based Classifiers2026.02 | 0.55 | 0.51 | 0.53 | 0.46 | |
| Qwen2.5-Coder-14B-InstSource Type=Open-Source, Model Scale=14B, Instruction Tuned=true2026.02 | 0.5375 | — | 0.5528 | 0.523 | |
| VulBERTa-CNNFramework Type=Pattern-Based Classifiers2026.02 | 0.44 | 0.5 | 0.51 | 0.38 | |
| Qwen2.5-Coder-7B-InstSource Type=Open-Source, Model Scale=7B, Instruction Tuned=true2026.02 | 0.3124 | — | 0.7941 | 0.1944 | |
| VulSimFramework Type=Pattern-Based Classifiers2026.02 | 0.31 | 0.33 | 0.31 | 0.31 |