Multiple Choice Question Answering on ARC-C French
37.47ScoreGamayun
Evaluation results
| Method | Links | |
|---|---|---|
| GamayunZero-shot=true, Chat Template=true2025.12 | 37.47 | |
| Qwen2.5Zero-shot=true, Chat Template=true2025.12 | 37.47 | |
| Qwen3Zero-shot=true, Chat Template=true2025.12 | 35.76 | |
| Gemma3Zero-shot=true, Chat Template=true2025.12 | 34.73 | |
| EuroLMZero-shot=true, Chat Template=true2025.12 | 34.22 | |
| Llama3.2Zero-shot=true, Chat Template=true2025.12 | 29.17 |