Reading Comprehension on Belebele (Estonian, Indonesian, Swahili, Turkish)
34.11Accuracy (Estonian)XGLM-7B5
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| XGLM-7B5Parameters=7.5B2026.01 | 34.11 | 35.22 | 32.44 | 35.22 | — | |
| BLOOMZ-7B1Parameters=7.1B2026.01 | 29.88 | 47.44 | 40.22 | 33.11 | — | |
| GoldfishBackbone=GPT-2, Training=from-scratch2026.01 | 29.33 | 28 | 27.11 | 30.89 | — | |
| SENSIABackbone=GPT-2, Alignment=sense-aligned2026.01 | 29.11 | 29.11 | 28.44 | 30.67 | — | |
| MCLBackbone=GPT-2, Alignment=dense-representation2026.01 | 26.67 | 27.89 | 26.78 | 25.89 | — | |
| GPT-2 + FTBackbone=GPT-2, Training=finetuned2026.01 | 25.22 | 23.44 | 24.89 | 26.56 | — | |
| DenseTarget Language=Turkish, Backbone=Llama-3.2-3B2026.03 | — | — | — | — | 59.11 | |
| LayerMoETarget Language=Turkish, Backbone=Llama-3.2-3B, Number of Experts=842026.03 | — | — | — | — | 61.78 | |
| NeuronMoETarget Language=Turkish, Backbone=Llama-3.2-3B, Number of Experts=50 (-40%)2026.03 | — | — | — | — | 61.33 |