Text Classification on MIND-CA (test)
98.5F1 ScoreAll-HQ
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| All-HQClassifier=DistilBERT, Training Set=All augmentations High Quality2021.06 | 98.5 | 98 | 0.011 | |
| All-LQClassifier=DistilBERT, Training Set=All augmentations Low Quality2021.06 | 97.8 | 97.3 | 0.015 | |
| AB-HQClassifier=DistilBERT, Training Set=Automated + Back-translation High Quality2021.06 | 97.2 | 96.3 | 0.022 | |
| AB-LQClassifier=DistilBERT, Training Set=Automated + Back-translation Low Quality2021.06 | 96.7 | 95.7 | 0.021 | |
| Dictionary AugmentationClassifier=DistilBERT, Training Set=Dictionary2021.06 | 94.7 | 93.6 | 0.028 | |
| Order AugmentationClassifier=DistilBERT, Training Set=Order2021.06 | 94.7 | 93.3 | 0.025 | |
| WordNet AugmentationClassifier=DistilBERT, Training Set=WordNet2021.06 | 94.7 | 93.2 | 0.033 | |
| Introductory Phrase AugmentationClassifier=DistilBERT, Training Set=Phrase2021.06 | 94.6 | 93 | 0.031 | |
| PPDB AugmentationClassifier=DistilBERT, Training Set=PPDB2021.06 | 94.6 | 92.9 | 0.03 | |
| FastText AugmentationClassifier=DistilBERT, Training Set=FastText2021.06 | 94.2 | 92.4 | 0.03 | |
| GloVe AugmentationClassifier=DistilBERT, Training Set=GloVe2021.06 | 94.2 | 92.5 | 0.028 | |
| Orig (baseline)Classifier=DistilBERT, Training Set=Original corpus2021.06 | 92.5 | 87.7 | 0.059 | |
| UK-MIND-20Classifier=DistilBERT, Training Set=UK-MIND-20 corpus2021.06 | 89.3 | 84.4 | 0.058 |