Document Classification on MLDoc 1.0 (test)
0.959Accuracy (DE)MultiFiT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| MultiFiTSetting=Supervised, Training Examples=1,000 target language2019.09 | 0.959 | 0.9607 | 0.9475 | 0.9025 | 0.9003 | 0.8765 | 0.9252 | |
| MultiFiT, no wikiSetting=Supervised, Training Examples=1,000 target language, Pre-training=No Wikipedia tokens2019.09 | 0.9523 | 0.9507 | 0.9465 | 0.893 | 0.8863 | 0.8752 | 0.9003 | |
| Monolingual BERTSetting=Supervised, Training Examples=1,000 target language2019.09 | 0.9493 | — | — | — | — | — | 0.9217 | |
| MultiBERTSetting=Supervised, Training Examples=1,000 target language2019.09 | 0.94 | 0.9515 | 0.932 | 0.8582 | 0.8748 | 0.8685 | 0.9072 | |
| MultiCCASetting=Supervised, Training Examples=1,000 target language2019.09 | 0.937 | 0.9445 | 0.9205 | 0.8555 | 0.8535 | 0.8565 | 0.873 | |
| LASER, paperSetting=Supervised, Training Examples=1,000 target language2019.09 | 0.927 | 0.8875 | 0.908 | 0.8593 | 0.8515 | 0.8465 | 0.8898 | |
| MultiFiT, pseudoSetting=Zero-shot, Training Examples=1,000 source language, Bootstrapping=Pseudo-labels2019.09 | 0.9162 | 0.791 | 0.8942 | 0.7602 | 0.6957 | 0.6783 | 0.8248 | |
| MultiFiTSetting=Supervised, Training Examples=100 target language2019.09 | 0.909 | 0.89 | 0.8503 | 0.8012 | 0.8055 | 0.7355 | 0.8802 | |
| LASER, codeSetting=Zero-shot, Training Examples=1,000 source language2019.09 | 0.8765 | 0.7548 | 0.84 | 0.7118 | 0.6458 | 0.6658 | 0.7665 | |
| LASER, paperSetting=Zero-shot, Training Examples=1,000 source language2019.09 | 0.8625 | 0.793 | 0.783 | 0.702 | 0.6095 | 0.6725 | 0.7098 | |
| MultiBERTSetting=Zero-shot, Training Examples=1,000 source language2019.09 | 0.8235 | 0.7498 | 0.8303 | 0.6827 | 0.6458 | 0.7158 | 0.6617 | |
| MultiCCASetting=Zero-shot, Training Examples=1,000 source language2019.09 | 0.812 | 0.725 | 0.7238 | 0.6938 | 0.6763 | 0.608 | 0.7473 |