Question Answering on IndicQA
49.7F1 ScoreIndicBERT-SS
Evaluation results
| Method | Links | |
|---|---|---|
| IndicBERT-SSZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 49.7 | |
| IndicBERT v2 +SamanantarZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 49.2 | |
| MuRILZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 48.3 | |
| IndicBERT v2Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 47.7 | |
| XLMRZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 44.8 | |
| IndicBERT v2 +Back-Trans.Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 42.2 | |
| v1-dataZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 37.6 | |
| mBERTZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 32.9 | |
| IndicBERT v1Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 10.1 |