Reasoning on Hebrew Reasoning Benchmarks Suite (Copa, ARC-AI2, HellaSwag, MMLU, GSM8K, Psychometric Psi)
93.3Copa (HE)Gemma-3-27B-IT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Gemma-3-27B-ITTraining Stage=SFT2026.05 | 93.3 | 91.4 | 63.6 | 72.5 | 82.8 | 54.3 | 76.3 | |
| HebatronTraining Stage=SFT2026.05 | 91.9 | 88 | 58.9 | 68.4 | 83.3 | 52.5 | 73.8 | |
| DictaLM-3.0-ThinkingTraining Stage=SFT2026.05 | 88 | 91.2 | 61.7 | 60.2 | 70.2 | 42.3 | 68.9 |