CWE Classification on CVE-to-CWE mapping dataset Temporal split 1 (test 1)
89.05Score (1,1,1)V2W-BERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=>1002021.02 | 89.05 | 94.7 | 97.63 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=>1002021.02 | 88.52 | 94.79 | 96.49 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=>1002021.02 | 85.24 | 94.25 | 96.16 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=>1002021.02 | 84.63 | 92.27 | 94.85 | |
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=All2021.02 | 83.62 | 91.4 | 94.42 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=All2021.02 | 82.32 | 91.01 | 93.63 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=All2021.02 | 78.28 | 88.03 | 91.32 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=All2021.02 | 77.5 | 89.3 | 92.98 | |
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=1-1002021.02 | 47.65 | 69.33 | 75.64 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=1-1002021.02 | 41.38 | 66.02 | 74.66 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=1-1002021.02 | 36.26 | 59.98 | 67.91 | |
| V2W-BERTEvaluation Approach=Link-based, Zero-shot=true2021.02 | 28.09 | 69.54 | 85.58 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=1-1002021.02 | 26.31 | 56.56 | 65.37 | |
| RandomEvaluation Approach=Link-based, Zero-shot=true2021.02 | 0.32 | 1.96 | 6.53 | |
| TF-IDF NNEvaluation Approach=Link-based, Zero-shot=true2021.02 | 0 | 11.58 | 48.75 |