Vulnerability Analysis and Reproduction on Vulnerability Benchmark Datasets
1,754Number of ProjectsCVEFixes
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CVEFixesType=Collected2026.06 | 1,754 | — | — | — | — | — | — | 5,495 | — | — | — | |
| VUDENCSource=Sec. issue, Real=real-world2025.09 | 812 | 7 | 1 | — | — | — | — | — | — | — | — | |
| DiverseVulSource=Sec. issue, Real=real-world2025.09 | 797 | 150 | 12 | — | — | — | — | — | — | — | — | |
| PrimeVulSource=Patch diff, Real=real-world2025.09 | 755 | 140 | 2 | — | — | — | — | — | — | — | — | |
| PrimeVulType=Collected2026.06 | 755 | — | — | — | — | — | — | 6,968 | — | — | — | |
| BigVulSource=Patch diff, Real=real-world2025.09 | 348 | 91 | 2 | — | — | — | — | — | — | — | — | |
| Big-VulType=Collected2026.06 | 348 | — | — | — | — | — | — | 3,754 | — | — | — | |
| OSS-Fuzz-OSVType=Collected2026.06 | 331 | — | — | — | — | — | — | 3,381 | — | — | — | |
| ARVOType=Collected2026.06 | 311 | — | — | — | — | — | — | 6,138 | — | — | — | |
| DiverseVulType=Collected2026.06 | 295 | — | — | — | — | — | — | 7,514 | — | — | — | |
| ARVOSource=OSS-Fuzz, Real=real-world2025.09 | 273 | 4 | 2 | — | — | — | — | — | — | — | — | |
| CVE-GENIESource=Public CVEs, Real=real-world2025.09 | 267 | 141 | 22 | — | — | — | — | — | — | — | — | |
| CGCType=Crafted2026.06 | 249 | — | — | — | — | — | — | 276 | — | — | — | |
| SARDSource=Manual, Real=synthetic2025.09 | 120 | 150 | 6 | — | — | — | — | — | — | — | — | |
| CVE-BenchSource=Public CVEs, Real=real-world2025.09 | 36 | 8 | 6 | — | — | — | — | — | — | — | — | |
| ExtractFixType=Crafted2026.06 | 7 | — | — | — | — | — | — | 30 | — | — | — | |
| MagmaType=Crafted2026.06 | 7 | — | — | — | — | — | — | 118 | — | — | — | |
| D2ASource=SA tool, Real=real-world2025.09 | 6 | 7 | 2 | — | — | — | — | — | — | — | — | |
| D2AType=Generated2026.06 | 6 | — | — | — | — | — | — | 18,653 | — | — | — | |
| DevignSource=Manual, Real=real-world2025.09 | 4 | — | 2 | — | — | — | — | — | — | — | — | |
| SecLLMHolmesSource=Manual, Real=mixed2025.09 | 4 | 8 | 3 | — | — | — | — | — | — | — | — | |
| LAVAType=Generated2026.06 | 4 | — | — | — | — | — | — | 2,265 | — | — | — | |
| Mu et al.Source=Public CVEs, Real=real-world2025.09 | 1 | 4 | 1 | — | — | — | — | — | — | — | — | |
| FormAIType=Generated2026.06 | 1 | — | — | — | — | — | — | 112,000 | — | — | — | |
| CrossVulSource=Patch diff, Real=real-world2025.09 | — | 168 | 40 | — | — | — | — | — | — | — | — | |
| CVEfixesSource=Patch diff, Real=real-world2025.09 | — | 180 | 30 | — | — | — | — | — | — | — | — | |
| DraperSource=SA tool, Real=mixed2025.09 | — | 9 | 2 | — | — | — | — | — | — | — | — | |
| SVENSource=Manual, Real=real-world2025.09 | — | 9 | 3 | — | — | — | — | — | — | — | — | |
| VulCheckerSource=Manual, Real=synthetic2025.09 | — | 5 | 2 | — | — | — | — | — | — | — | — |