Vulnerability Detection on REVEAL Chromium Linux Debian Kernel (test)
0.483PrecisionDISCO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| DISCOtraining_objective=MLM+CLR++NT-MLM2021.10 | 0.483 | 0.446 | 0.464 | |
| GraphCodeBERT2021.10 | 0.479 | 0.439 | 0.458 | |
| DISCOtraining_objective=MLM2021.10 | 0.455 | 0.31 | 0.369 | |
| CodeBERT2021.10 | 0.446 | 0.458 | 0.452 | |
| ROBERTa2021.10 | 0.445 | 0.39 | 0.416 | |
| TransformerLayers=12-Layer2021.10 | 0.416 | 0.453 | 0.434 | |
| DISCOtraining_objective=MLM+CLR+/-2021.10 | 0.394 | 0.505 | 0.442 | |
| DISCOtraining_objective=MLM+CLR+2021.10 | 0.386 | 0.477 | 0.426 | |
| Devign2021.10 | 0.346 | 0.267 | 0.299 | |
| REVEAL2021.10 | 0.308 | 0.609 | 0.413 | |
| SySeVR2021.10 | 0.245 | 0.401 | 0.303 | |
| VulDeePecker2021.10 | 0.177 | 0.139 | 0.157 |