Commonsense Reasoning on Hellaswag French
54.36ScoreGamayun
Evaluation Results
| Method | Links | |
|---|---|---|
| GamayunZero-shot=true, Chat Template=true2025.12 | 54.36 | |
| EuroLMZero-shot=true, Chat Template=true2025.12 | 52.85 | |
| Qwen2.5Zero-shot=true, Chat Template=true2025.12 | 51.15 | |
| Gemma3Zero-shot=true, Chat Template=true2025.12 | 48.83 | |
| Qwen3Zero-shot=true, Chat Template=true2025.12 | 48.35 | |
| Llama3.2Zero-shot=true, Chat Template=true2025.12 | 43 |