Vulnerability Detection on BigVul Seed: Devign (test)
11.64PrecisionVulScribeR
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| VulScribeRModel Architecture=Reveal2025.08 | 11.64 | 38 | 17.82 | |
| VulScribeRModel Architecture=LineVul2025.08 | 11.43 | 18.81 | 14.22 | |
| AVIATORModel Architecture=LineVul2025.08 | 11.27 | 29.99 | 16.38 | |
| ROSModel Architecture=LineVul2025.08 | 10.91 | 13.16 | 11.93 | |
| AVIATORModel Architecture=Devign2025.08 | 9.59 | 24.8 | 13.83 | |
| AVIATORModel Architecture=Reveal2025.08 | 9.19 | 56.94 | 15.82 | |
| VulScribeRModel Architecture=Devign2025.08 | 8.79 | 29.41 | 13.53 | |
| VulGenModel Architecture=LineVul2025.08 | 8.51 | 22.15 | 12.29 | |
| AVIATORModel Architecture=CodeT52025.08 | 8.08 | 65.89 | 14.39 | |
| ROSModel Architecture=Reveal2025.08 | 7.96 | 33.39 | 12.86 | |
| No AugModel Architecture=LineVul2025.08 | 7.9 | 29.19 | 12.43 | |
| ROSModel Architecture=Devign2025.08 | 7.54 | 25.6 | 11.65 | |
| ROSModel Architecture=CodeT52025.08 | 7.52 | 51.81 | 13.13 | |
| VulGenModel Architecture=CodeT52025.08 | 7.34 | 31.05 | 11.87 | |
| No AugModel Architecture=Reveal2025.08 | 7.28 | 77.27 | 13.31 | |
| VGXModel Architecture=CodeT52025.08 | 7.2 | 80.17 | 13.21 | |
| VulScribeRModel Architecture=CodeT52025.08 | 7.09 | 76.09 | 12.97 | |
| VGXModel Architecture=Reveal2025.08 | 6.89 | 73.29 | 12.6 | |
| VulGenModel Architecture=Devign2025.08 | 6.49 | 62.32 | 11.75 | |
| VulGenModel Architecture=Reveal2025.08 | 6.36 | 70.59 | 11.66 | |
| No AugModel Architecture=Devign2025.08 | 6.27 | 43.24 | 10.95 | |
| No AugModel Architecture=CodeT52025.08 | 6.08 | 65.71 | 11.13 | |
| VGXModel Architecture=Devign2025.08 | 6.06 | 59.3 | 10.99 | |
| VGXModel Architecture=LineVul2025.08 | 5.35 | 98.82 | 10.15 |