Vulnerability Detection & Localization on PrimeVul (test)
11.7Top-1 AccuracyANVIL
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| ANVILDataset=N/A, Backbone=CodeLlama-13B2024.08 | 11.7 | 31.3 | 41.4 | 25 | 0.18 | 61.8 | |
| LLMAODataset=BigVul2024.08 | 9.2 | 17.3 | 26.2 | 49.3 | 0.39 | 51.8 | |
| LineVDDataset=BigVul2024.08 | 9.2 | 15.4 | 23.1 | 38 | 0.3 | 49.6 | |
| LLMAODataset=Devign2024.08 | 4.4 | 14 | 22.5 | 50.7 | 0.4 | 50.7 | |
| LineVulDataset=BigVul, Backbone=CodeBERT, Truncation=512 tokens2024.08 | 4 | 17 | 30 | 17.6 | 0.71 | 49.6 |