Extractive Question Answering on ChAII (test)
53Jaccard Score (Overall)MuCoT (SQuAD + Dravidian + Contrastive)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MuCoT (SQuAD + Dravidian + Contrastive)SQuAD pre-training=Yes, Translations=Dravidian (ml, te), Contrastive Training=Yes2022.04 | 53 | 57 | 45 | |
| MuCoT (SQuAD + Indo-Aryan + Contrastive)SQuAD pre-training=Yes, Translations=Indo-Aryan (bn, mr), Contrastive Training=Yes2022.04 | 52 | 58 | 40 | |
| MuCoT (SQuAD + All Languages + Contrastive)SQuAD pre-training=Yes, Translations=All languages, Contrastive Training=Yes2022.04 | 52 | 57 | 41 | |
| MuCoT (SQuAD + Indo-Aryan)SQuAD pre-training=Yes, Translations=Indo-Aryan (bn, mr), Contrastive Training=No2022.04 | 51 | 59 | 35 | |
| MuCoT (SQuAD)SQuAD pre-training=Yes, Translations=No, Contrastive Training=No2022.04 | 50 | 57 | 37 | |
| MuCoT (SQuAD + Dravidian)SQuAD pre-training=Yes, Translations=Dravidian (ml, te), Contrastive Training=No2022.04 | 49 | 52 | 44 | |
| MuCoT (SQuAD + All Languages)SQuAD pre-training=Yes, Translations=All languages, Contrastive Training=No2022.04 | 49 | 54 | 39 | |
| MuCoT (Baseline)SQuAD pre-training=No, Translations=No, Contrastive Training=No2022.04 | 44 | 47 | 39 |