Logical Reasoning on HRLs (High-Resource Languages)
93.4BPA ScoreGemma-2-9B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma-2-9BConfiguration=SFT2026.02 | 93.4 | 4.4 | |
| Gemma-3-12BConfiguration=Steering2026.02 | 90.1 | — | |
| Gemma-2-9BConfiguration=Steering2026.02 | 89 | — | |
| Qwen-3-14BConfiguration=Steering2026.02 | 86.9 | — | |
| Qwen-2.5-7BConfiguration=Steering2026.02 | 86.1 | — | |
| Ministral-14BConfiguration=Steering2026.02 | 86.1 | — | |
| Qwen-2.5-7BConfiguration=SFT2026.02 | 84.6 | -1.5 | |
| Mistral-7BConfiguration=SFT2026.02 | 78.2 | 2.8 | |
| Mistral-7BConfiguration=Steering2026.02 | 75.4 | — | |
| Gemma-3-12BConfiguration=Base Model2026.02 | 63.5 | — | |
| Gemma-2-9BConfiguration=CoT2026.02 | 58.5 | -30.5 | |
| Qwen-2.5-7BConfiguration=CoT2026.02 | 57.7 | -28.4 | |
| Qwen-3-14BConfiguration=Base Model2026.02 | 57.5 | — | |
| Ministral-14BConfiguration=Base Model2026.02 | 49.2 | — | |
| Gemma-2-9BConfiguration=Base Model2026.02 | 43.9 | — | |
| Qwen-2.5-7BConfiguration=Base Model2026.02 | 42.9 | — | |
| Mistral-7BConfiguration=CoT2026.02 | 34.2 | -41.2 | |
| Mistral-7BConfiguration=Base Model2026.02 | 30 | — |