Paraphrase Detection on IndicXPara
60.8AccuracyMuRIL
Evaluation results
| Method | Links | |
|---|---|---|
| MuRILZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 60.8 | |
| IndicBERT v2 +SamanantarZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 57 | |
| IndicBERT v2Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 56.9 | |
| XLMRZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 56.7 | |
| IndicBERT-SSZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 56.4 | |
| mBERTZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 55.2 | |
| IndicBERT v2 +Back-Trans.Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 50.7 | |
| v1-dataZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 49.6 | |
| IndicBERT v1Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 47.5 |