Diacritization on Custom Hebrew Diacritization Corpus
86.86Macro AccuracyDictaLM-3.0-24B-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| DictaLM-3.0-24B-ThinkingSize Category=Large, Reasoning Mode=Thinking2026.02 | 86.86 | |
| DictaLM-3.0-Nemotron-12B-InstructSize Category=Smaller (~12B)2026.02 | 76.12 | |
| gemma3-27B-itSize Category=Large2026.02 | 60.21 | |
| DictaLM-3.0-1.7B-InstructSize Category=Tiny (~1.7B)2026.02 | 52.76 | |
| gemma-3-12b-itSize Category=Smaller (~12B)2026.02 | 51.78 | |
| DictaLM-3.0-1.7B-ThinkingSize Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 47.2 | |
| aya-expanse-32BSize Category=Large2026.02 | 45.4 | |
| Qwen3-14B (think)Size Category=Smaller (~12B), Reasoning Mode=Thinking2026.02 | 4.73 | |
| Llama-3.3-70B-InstructSize Category=Large2026.02 | 4.05 | |
| gemma-3-1b-itSize Category=Tiny (~1.7B)2026.02 | 3.44 | |
| Qwen3-1.7B (think)Size Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 2.93 |