Multilingual Reading Comprehension on BELEBELE (hi, ne, bn, te, sw, en)
71.22Accuracy (hi)SARA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SARABackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 71.22 | 65 | 61.56 | 11 | 61.67 | 93.44 | 58.83 | |
| ShifConBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 70.15 | 64.85 | 58.45 | 5 | 59.85 | 93.65 | 57.83 | |
| FFTBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 68.89 | 64.56 | 55.56 | 0 | 58.22 | 93.78 | 56.84 | |
| AESBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 67.25 | 63.15 | 53.25 | 0 | 56.15 | 92.55 | 55.39 | |
| Vanilla LMBackbone=Phi-3.5-MoE-instruct, Semantic Anchor=English2026.06 | 10.33 | 1.11 | 24.44 | 0 | 0.56 | 51 | 14.57 |