Statement-level classification on BigVul
88.24MCCDCVD
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DCVDDetection Phase Protocol=Two-Phase2026.05 | 88.24 | 92.59 | 84.18 | 88.18 | |
| DCVDDetection Phase Protocol=One-Phase2026.05 | 87.91 | 92.7 | 84.78 | 88.56 | |
| MatsVDDetection Phase Protocol=Two-Phase2026.05 | 86.06 | 91.57 | 81.13 | 86.03 | |
| MatsVDDetection Phase Protocol=One-Phase2026.05 | 85.85 | 89.9 | 84.86 | 87.31 | |
| VELVETDetection Phase Protocol=Two-Phase2026.05 | 69.66 | 68.74 | 71.23 | 69.96 | |
| VELVETDetection Phase Protocol=One-Phase2026.05 | 67.81 | 59.87 | 86.25 | 70.68 | |
| LineVulDetection Phase Protocol=One-Phase2026.05 | 52.99 | 62.38 | 53.4 | 57.54 | |
| LineVulDetection Phase Protocol=Two-Phase2026.05 | 49.51 | 62.1 | 47.45 | 53.79 | |
| LineVDDetection Phase Protocol=One-Phase2026.05 | 45.06 | 40.94 | 67.38 | 50.93 | |
| LineVDDetection Phase Protocol=Two-Phase2026.05 | 38.99 | 35.52 | 63.86 | 45.65 | |
| IVDetectDetection Phase Protocol=One-Phase2026.05 | 35.64 | 31.52 | 65.06 | 42.47 | |
| IVDetectDetection Phase Protocol=Two-Phase2026.05 | 30.14 | 28.36 | 58.46 | 38.19 | |
| ICVHDetection Phase Protocol=One-Phase2026.05 | 26.56 | 27.34 | 50.76 | 35.54 | |
| TextCNNDetection Phase Protocol=One-Phase2026.05 | 22.06 | 26.24 | 40.27 | 31.78 | |
| ICVHDetection Phase Protocol=Two-Phase2026.05 | 18.04 | 21.39 | 43.85 | 28.75 | |
| TextCNNDetection Phase Protocol=Two-Phase2026.05 | 14.04 | 21.1 | 30.15 | 24.83 |