Mathematical Reasoning on MGSM Māori
41.6AccuracyGemma-3 (27B-IT)
Evaluation Results
| Method | Links | |
|---|---|---|
| Gemma-3 (27B-IT)Zero-shot=true, Instruction-tuned=true, Model scale category=12B+ Models2026.01 | 41.6 | |
| BYOL-mri (12B-M)Zero-shot=true, Instruction-tuned=true, Model scale category=12B+ Models2026.01 | 38.8 | |
| BYOL-mri (4B-M)Zero-shot=true, Instruction-tuned=true, Model scale category=4B-8B Models2026.01 | 27.6 | |
| Llama-3.1 (Instruct-8B)Zero-shot=true, Instruction-tuned=true, Model scale category=4B-8B Models2026.01 | 15.2 |