Question Answering on XTREME QA Order 1 - Short Sequence (test)
57.85EMCTTA-T
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CTTA-TBackbone=XLMR-Base-xTune2025.12 | 57.85 | 69.72 | |
| xTuneBackbone=XLMR-Base-xTune2025.12 | 56.96 | 68.98 | |
| SARBackbone=XLMR-Base-xTune2025.12 | 55.5 | 66.86 | |
| CTTA-TBackbone=XLM-RoBERTa-Base2025.12 | 54.14 | 66.57 | |
| CoTTABackbone=XLM-RoBERTa-Base2025.12 | 53.81 | 65.75 | |
| baseBackbone=XLM-RoBERTa-Base2025.12 | 52.52 | 65.45 | |
| SARBackbone=XLM-RoBERTa-Base2025.12 | 51.8 | 61.68 | |
| CoTTABackbone=XLMR-Base-xTune2025.12 | 51.49 | 63.57 | |
| TentBackbone=XLMR-Base-xTune2025.12 | 50.72 | 62.13 | |
| REMBackbone=XLMR-Base-xTune2025.12 | 49.72 | 61.07 | |
| OILBackbone=XLMR-Base-xTune2025.12 | 44.59 | 57.01 | |
| SoTTABackbone=XLMR-Base-xTune2025.12 | 42.41 | 53.79 | |
| OILBackbone=XLM-RoBERTa-Base2025.12 | 39.53 | 53.31 | |
| REMBackbone=XLM-RoBERTa-Base2025.12 | 39.45 | 49.16 | |
| SoTTABackbone=XLM-RoBERTa-Base2025.12 | 35.23 | 45.67 | |
| TentBackbone=XLM-RoBERTa-Base2025.12 | 28.83 | 34.43 |