Extractive Question Answering on Molweni (test)
60.57EMiLoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| iLoRAEvaluation Protocol=Fine-tuned2026.05 | 60.57 | 74.51 | |
| ELECTRA-ourModel Setting=Adaptation Model, Backbone=ELECTRA-large2023.05 | 58.13 | 72.54 | |
| MLEEvaluation Protocol=Fine-tuned2026.05 | 57.78 | 72.83 | |
| MCDEvaluation Protocol=Fine-tuned2026.05 | 57.51 | 72.33 | |
| ELECTRA-largeModel Setting=Adaptation Model, Backbone=ELECTRA-large2023.05 | 57.41 | 70.97 | |
| ENSEvaluation Protocol=Fine-tuned2026.05 | 57.09 | 72.38 | |
| MAPEvaluation Protocol=Fine-tuned2026.05 | 57.02 | 72.66 | |
| BLOBEvaluation Protocol=Fine-tuned2026.05 | 55.9 | 70.8 | |
| BERT-ourModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 51.31 | 64.52 | |
| BERT-ourModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 51.17 | 64.89 | |
| BERT+CRM+MLMModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 50.03 | 63.54 | |
| BERT+CRMModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 49.66 | 63.31 | |
| SPIDER-BERTModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 48.69 | 62.79 | |
| BERT-baseModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 47.78 | 61.77 | |
| SPIDER-BERTModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 47.68 | 61.16 | |
| BERT+CRMModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 47.58 | 61.74 | |
| BERT+CRM+MLMModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 47.51 | 62.43 | |
| MPC-BERTModel Setting=Adaptation Model, Backbone=BERT-base2023.05 | 47.29 | 61.72 | |
| MPC-BERTModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 46.84 | 60.11 | |
| BERT-baseModel Setting=Vanilla Model, Backbone=BERT-base2023.05 | 46.81 | 60.2 | |
| Zero-shotEvaluation Protocol=Zero-shot2026.05 | 35.7 | 56.32 |