Wikipedia Section Title Prediction on IndicGLUE (test)
81.5panGlot500-m
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Glot500-mzero-shot=true2024.01 | 81.5 | 83.6 | 85.5 | 83.2 | 85.2 | 84.4 | 84.7 | 83.9 | 96.6 | 83.1 | 83.6 | 85 | 85 | |
| FURINAIndiczero-shot=true, backbone=Glot500-m2024.01 | 81.2 | 83.9 | 85.8 | 83.7 | 85.2 | 84.8 | 85.6 | 84.3 | 96.6 | 83.8 | 83.8 | 85.3 | 85.3 | |
| ALBERTUSzero-shot=true, pre-training data=romanized only2024.01 | 77.6 | 82.2 | 84.4 | 81.5 | 81.7 | 82.4 | 82.7 | — | — | — | — | 81.8 | 81.8 |