Question Answering on XTREME QA Order 5 - Long Sequence (test)
60.92EMCTTA-T
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CTTA-TBackbone=XLMR-Base-xTune2025.12 | 60.92 | 72.18 | |
| xTuneBackbone=XLMR-Base-xTune2025.12 | 59.93 | 71.44 | |
| CTTA-TBackbone=XLM-RoBERTa-Base2025.12 | 57.63 | 69.33 | |
| baseBackbone=XLM-RoBERTa-Base2025.12 | 55.94 | 68.27 | |
| SARBackbone=XLMR-Base-xTune2025.12 | 55.59 | 66.78 | |
| CoTTABackbone=XLMR-Base-xTune2025.12 | 55.57 | 67.61 | |
| SARBackbone=XLM-RoBERTa-Base2025.12 | 52.77 | 64.55 | |
| OILBackbone=XLMR-Base-xTune2025.12 | 51 | 61.19 | |
| REMBackbone=XLMR-Base-xTune2025.12 | 50.69 | 62.15 | |
| SoTTABackbone=XLMR-Base-xTune2025.12 | 47.04 | 57.79 | |
| OILBackbone=XLM-RoBERTa-Base2025.12 | 43.48 | 53.42 | |
| SoTTABackbone=XLM-RoBERTa-Base2025.12 | 38.15 | 50.2 | |
| REMBackbone=XLM-RoBERTa-Base2025.12 | 35.28 | 44.94 | |
| CoTTABackbone=XLM-RoBERTa-Base2025.12 | 23.77 | 31.84 | |
| TentBackbone=XLMR-Base-xTune2025.12 | 23.06 | 29.26 | |
| TentBackbone=XLM-RoBERTa-Base2025.12 | 19.69 | 27.19 |