Reading Comprehension on BELEBELE (Hindi, Nepali, Bengali, Telugu, Swahili, English, Chinese)
83.44Accuracy (Hindi)SARA
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SARAAnchor=English2026.06 | 83.44 | 80.89 | 83.67 | 77.44 | 77.89 | 95.22 | — | 83.09 | |
| SARAAnchor=Chinese2026.06 | 83.22 | 79.56 | 83.44 | 76.67 | 77.44 | — | 91.89 | 82.04 | |
| ShifConAnchor=English2026.06 | 82.85 | 80.75 | 83.58 | 77.02 | 77.84 | 95.12 | — | 82.86 | |
| Vanilla LMAnchor=None2026.06 | 82.78 | 79.67 | 84.89 | 73.11 | 56.22 | 94.67 | 91.78 | 78.32 | |
| FFTAnchor=English2026.06 | 82.22 | 82 | 84.11 | 76.56 | 77.78 | 95 | — | 82.95 | |
| ShifConAnchor=Chinese2026.06 | 82.05 | 79.45 | 83.35 | 76.58 | 76.55 | — | 91.82 | 81.63 | |
| FFTAnchor=Chinese2026.06 | 80.89 | 81.44 | 84.44 | 76.78 | 75.67 | — | 92 | 81.87 | |
| AESAnchor=English2026.06 | 79.53 | 78.85 | 81.54 | 74.58 | 73.52 | 93.84 | — | 80.31 | |
| AESAnchor=Chinese2026.06 | 78.56 | 78.03 | 80.58 | 73.54 | 71.09 | — | 90.55 | 78.73 |