Vulnerability Detection on VulDeePecker
97.76F1 ScoreVulStyle
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| VulStyle2026.04 | 97.76 | 93.63 | 875 | 15,021 | 20 | 99 | 99.25 | 89.83 | |
| VulBERTa-CNN2026.04 | 95.26 | 90.86 | 885 | 14,997 | 44 | 89 | 99.16 | 90.86 | |
| White-BasiliskTraining Strategy=Dataset-Specific2025.07 | 93.9 | 97.2 | — | — | — | — | — | — | |
| UniXcodervariant=Baseline2026.04 | 93.44 | 98.08 | 869 | 15,024 | 17 | 105 | 99.23 | 89.21 | |
| CodeBERTvariant=Baseline2026.04 | 93.2 | 98.18 | 864 | 15,025 | 16 | 110 | 99.21 | 88.7 | |
| VulBERTa-MLP2026.04 | 93.03 | 95.76 | 881 | 15,002 | 39 | 99 | 95.76 | 93.03 | |
| VulBERTa-MLP2025.07 | 93 | 95.8 | — | — | — | — | — | — | |
| VulDeePecker2025.07 | 92.9 | 91.9 | — | — | — | — | — | — | |
| White-BasiliskTraining Strategy=Unified2025.07 | 92.5 | 93.9 | — | — | — | — | — | — | |
| VulBERTa-CNN2025.07 | 90.9 | 95.3 | — | — | — | — | — | — | |
| Baseline-TextCNN2025.07 | 75.8 | 63.5 | — | — | — | — | — | — | |
| Baseline-BiLSTM2025.07 | 67 | 52.6 | — | — | — | — | — | — |