Instruction Following on IFEval Catalan (CA)
76.81Strict AccuracyQwen2 14B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2 14BType=Instruct2026.03 | 76.81 | |
| Qwen2 8BType=Instruct2026.03 | 74.59 | |
| Qwen2 14BType=merge-multi2026.03 | 67.25 | |
| Qwen2 14BType=merge-*2026.03 | 66 | |
| Qwen2 8BType=merge-multi2026.03 | 61.51 | |
| Qwen2 8BType=merge-*2026.03 | 59.45 | |
| Llama 3.1 8BType=Instruct2026.03 | 52.03 | |
| Llama 3.1 8BType=merge-*2026.03 | 46.96 | |
| Llama 3.1 8BVariant=joint-EU2026.03 | 46.71 | |
| Llama 3.1 8BType=merge-multi2026.03 | 45.03 | |
| ALIA 40BType=Instruct2026.03 | 41.17 | |
| Salamandra 7BType=Instruct2026.03 | 34.93 | |
| Salamandra 2BType=Instruct2026.03 | 25.2 |