Cloze Style Question Answering on IndicGLUE (test)
40.6Panjabi AccuracyFURINAIndic
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FURINAIndiczero-shot=true, backbone=Glot500-m2024.01 | 40.6 | 46.8 | 44.9 | 45.2 | 47.3 | 85.9 | 51.7 | 39.7 | 32.3 | 38.2 | 37.7 | 46.4 | 46.4 | |
| ALBERTUSzero-shot=true, pre-training data=romanized only2024.01 | 32.8 | 38.5 | 36.4 | 36 | 37.4 | 70.2 | 39.5 | — | — | — | — | 41.5 | 41.5 | |
| Glot500-mzero-shot=true2024.01 | 29.8 | 28.8 | 27.7 | 29.4 | 31.8 | 82.7 | 32.1 | 28.9 | 26.3 | 27.5 | 29.3 | 34 | 34 |