Translation on Custom English-to-Hebrew
30.09Win Rate (GPT-4o Judge)DictaLM-3.0-24B-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| DictaLM-3.0-24B-ThinkingSize Category=Large, Reasoning Mode=Thinking2026.02 | 30.09 | |
| gemma3-27B-itSize Category=Large2026.02 | 26.73 | |
| Llama-3.3-70B-InstructSize Category=Large2026.02 | 19.31 | |
| aya-expanse-32BSize Category=Large2026.02 | 17.1 | |
| gemma-3-12b-itSize Category=Smaller (~12B)2026.02 | 16.5 | |
| DictaLM-3.0-Nemotron-12B-InstructSize Category=Smaller (~12B)2026.02 | 13.5 | |
| DictaLM-3.0-1.7B-ThinkingSize Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 2.51 | |
| DictaLM-3.0-1.7B-InstructSize Category=Tiny (~1.7B)2026.02 | 2.16 | |
| Qwen3-14B (think)Size Category=Smaller (~12B), Reasoning Mode=Thinking2026.02 | 0.9 | |
| gemma-3-1b-itSize Category=Tiny (~1.7B)2026.02 | 0.15 | |
| Qwen3-1.7B (think)Size Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 0 |