Vulnerability Detection on CodeXGLUE (test)
65.8AccuracyDISCO
Evaluation Results
| Method | Links | |
|---|---|---|
| DISCOtraining_objective=MLM+CLR++NT-MLM2021.10 | 65.8 | |
| DISCOtraining_objective=MLM+CLR+2021.10 | 64.4 | |
| DISCOobjective=MLM+CLR+2021.10 | 64.4 | |
| DISCOobjective=MLM+CLR++NT-MLM2021.10 | 63.8 | |
| C-BERT2021.10 | 63.6 | |
| DISCOtraining_objective=MLM+CLR+/-2021.10 | 63.6 | |
| C-BERTnote=test data can be different from other baselines2021.10 | 63.6 | |
| DISCOobjective=MLM+CLR±2021.10 | 63.6 | |
| GraphCodeBERT2021.10 | 63.2 | |
| GraphCodeBERT2021.10 | 63.2 | |
| CodeBERT2021.10 | 62.1 | |
| CodeBERT2021.10 | 62.1 | |
| Transformer2021.10 | 62 | |
| Transformerlayers=12-Layer2021.10 | 62 | |
| DISCOtraining_objective=MLM2021.10 | 61.8 | |
| DISCOobjective=MLM2021.10 | 61.8 | |
| ROBERTa2021.10 | 61 | |
| RoBERTa2021.10 | 61 |