Cross-lingual Classification on Webis-CLS-10 (test)
86.3German BooksUpper Baseline
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Upper Baselinebound=Upper2018.10 | 86.3 | 83.7 | 84.9 | 84.4 | 84.3 | 87.6 | 80.2 | 81.4 | 83.4 | 84 | — | — | — | |
| PyDCIvariant=Cosine2018.10 | 85 | 83.7 | 85.2 | 81.6 | 85.1 | 84.2 | 79 | 80.2 | 83.8 | 83.1 | — | — | — | |
| PyDCIvariant=Linear2018.10 | 84.6 | 84.1 | 86.5 | 83.4 | 83.5 | 82.4 | 79.6 | 83 | 81.1 | 83.1 | — | — | — | |
| BiDRL2018.10 | 84.1 | 84.1 | 84.7 | 84.4 | 83.6 | — | — | — | 78.8 | 81.3 | — | — | — | |
| JaDCIvariant=Cosine2018.10 | 82.7 | 82.2 | 85.6 | 84.2 | 82.7 | 84.4 | 75.8 | 80.1 | 83.9 | 82.4 | — | — | — | |
| JaDCIvariant=Linear2018.10 | 79.8 | 82.6 | 84.4 | 74.6 | 82.3 | 81.6 | 77.9 | 82.2 | 82.6 | 80.9 | — | — | — | |
| Lower Baselinebound=Lower2018.10 | 52.3 | 56.2 | 55.8 | 55.8 | 53.7 | 56.6 | 49.8 | 50 | 50.9 | 53.4 | — | — | — | |
| CamemBERT2019.12 | — | — | — | — | — | — | — | — | — | — | 92.3 | 93 | 94.85 | |
| CLDFA2018.10 | — | — | — | — | — | 83.3 | 77.4 | 80.5 | — | — | — | — | — | |
| FlauBERTModel Size=BASE2019.12 | — | — | — | — | — | — | — | — | — | — | 93.1 | 92.45 | 94.1 | |
| FlauBERTModel Size=LARGE2019.12 | — | — | — | — | — | — | — | — | — | — | 95 | 94.1 | 95.85 | |
| mBERT2019.12 | — | — | — | — | — | — | — | — | — | — | 86.15 | 86.9 | 86.65 | |
| MultiFiT2019.12 | — | — | — | — | — | — | — | — | — | — | 91.25 | 89.55 | 93.4 |