Machine Reading Comprehension on BELEBELE Swahili
42.6Accuracy (Target)CLO
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CLOModel=Llama-3-8B, Zero-shot=true2025.05 | 42.6 | 75.9 | |
| SFTModel=Llama-3-8B, Zero-shot=true2025.05 | 42 | 75 | |
| CLOModel=Qwen2.5-3B, Zero-shot=true2025.05 | 39.8 | 83.1 | |
| CLOModel=Mistral-7B-v0.1, Zero-shot=true2025.05 | 38.8 | 69.8 | |
| SFTModel=Qwen2.5-3B, Zero-shot=true2025.05 | 36.6 | 82.9 | |
| SFTModel=Mistral-7B-v0.1, Zero-shot=true2025.05 | 34.3 | 72.3 | |
| CLOModel=Llama-2-13B, Zero-shot=true2025.05 | 32.3 | 58.7 | |
| CLOModel=Llama-2-7B, Zero-shot=true2025.05 | 28.6 | 37.3 | |
| SFTModel=Llama-2-13B, Zero-shot=true2025.05 | 26.6 | 57.4 | |
| SFTModel=Llama-2-7B, Zero-shot=true2025.05 | 23.9 | 36.2 |