Slot Filling on MASSIVE Slotfill
57.3F1IndicBERT v2 +Samanantar
Evaluation results
| Method | Links | |
|---|---|---|
| IndicBERT v2 +SamanantarZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 57.3 | |
| IndicBERT-SSZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 57.3 | |
| MuRILZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 57 | |
| IndicBERT v2Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 56.7 | |
| IndicBERT v2 +Back-Trans.Zero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 54.6 | |
| XLMRZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 50 | |
| OmniSONAR-Tokenevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 49.1 | |
| OmniSONARevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 48.6 | |
| SONARevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 40.2 | |
| MEXMAevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 39.6 | |
| v1-dataZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 34.4 | |
| XLM-Alignevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 29.1 | |
| XLM-Robertaevaluation_protocol=zero-shot, encoder_state=frozen, training_data=English2026.03 | 28.6 | |
| mBERTZero-shot=true, Averaged across languages=true, Development Set=English2022.12 | 6.2 |