CWE Classification on CVE-to-CWE mapping dataset Temporal 2 (test)
81.13Top-K Accuracy (1,1,1)V2W-BERT
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=>1002021.02 | 81.13 | 91.23 | 94.92 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=>1002021.02 | 80.67 | 90.64 | 94.14 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=>1002021.02 | 78.15 | 89.53 | 94.04 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=>1002021.02 | 76.04 | 87.38 | 91.53 | |
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=All2021.02 | 73.45 | 85.94 | 91.51 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=All2021.02 | 71.63 | 85.78 | 90.38 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=All2021.02 | 68.86 | 82.31 | 87.61 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=All2021.02 | 68.63 | 81.96 | 87.06 | |
| V2W-BERTEvaluation Approach=Link-based, Training frequency subset=1-1002021.02 | 40.72 | 62.93 | 71.79 | |
| TF-IDF NNEvaluation Approach=Link-based, Training frequency subset=1-1002021.02 | 33.95 | 56.4 | 65.9 | |
| BERTCVEEvaluation Approach=Classification-based, Training frequency subset=1-1002021.02 | 29.14 | 61.05 | 69.02 | |
| TF-IDF NNEvaluation Approach=Classification-based, Training frequency subset=1-1002021.02 | 25.19 | 48.38 | 57.39 | |
| V2W-BERTEvaluation Approach=Link-based, Zero-shot=true2021.02 | 10.12 | 34.75 | 61.04 | |
| RandomEvaluation Approach=Link-based, Zero-shot=true2021.02 | 0.32 | 1.96 | 6.53 | |
| TF-IDF NNEvaluation Approach=Link-based, Zero-shot=true2021.02 | 0 | 5.62 | 17.17 |