Instruction Following on IFEval (Language-Specific Performance)
23Arabic IFEval ScoreRA-MoE
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| RA-MoEModel=Qwen1.52026.05 | 23 | 21.7 | 23.8 | 29.8 | 27.1 | 30.6 | |
| RISEModel=Qwen1.52026.05 | 21.9 | 21.1 | 22.7 | 29.4 | 26.2 | 30.7 | |
| SFTModel=Qwen1.52026.05 | 21.4 | 20.5 | 22.3 | 28.9 | 25.8 | 29.6 | |
| RA-MoEModel=DSV22026.05 | 19.6 | 16.5 | 25.8 | 31.6 | 27.3 | 31.4 | |
| RA-MoEModel=OLMoE2026.05 | 19.2 | 15.5 | 18.9 | 28.9 | 22.5 | 28.7 | |
| RSModel=Qwen1.52026.05 | 19.1 | 19.9 | 20 | 29.3 | 23.5 | 28.9 | |
| 0-shotModel=Qwen1.52026.05 | 18.8 | 18.9 | 20.5 | 28.9 | 22.9 | 28.4 | |
| RISEModel=DSV22026.05 | 18.5 | 15.6 | 25 | 30.9 | 26.7 | 30.2 | |
| RISEModel=OLMoE2026.05 | 18.4 | 14.5 | 17.5 | 28.2 | 21.6 | 27.9 | |
| SFTModel=DSV22026.05 | 18.2 | 15.3 | 24.6 | 30.5 | 26.4 | 30 | |
| SFTModel=OLMoE2026.05 | 18.1 | 14.1 | 17.8 | 27.8 | 21.3 | 27.5 | |
| RSModel=DSV22026.05 | 14.7 | 13 | 14.9 | 28.1 | 19.4 | 26.9 | |
| 0-shotModel=DSV22026.05 | 14.4 | 11.7 | 15.1 | 27.4 | 19.5 | 26.5 | |
| 0-shotModel=OLMoE2026.05 | 13.7 | 11.7 | 13.8 | 23.7 | 17.5 | 23.1 | |
| RSModel=OLMoE2026.05 | 13.3 | 12.4 | 14.4 | 24.5 | 17.8 | 24.5 |