Question Answering on Israeli Trivia 300 questions
60.13AccuracyDictaLM-3.0-24B-Thinking
Evaluation results
| Method | Links | |
|---|---|---|
| DictaLM-3.0-24B-ThinkingSize Category=Large, Reasoning Mode=Thinking2026.02 | 60.13 | |
| Llama-3.3-70B-InstructSize Category=Large2026.02 | 60.13 | |
| aya-expanse-32BSize Category=Large2026.02 | 53.82 | |
| gemma3-27B-itSize Category=Large2026.02 | 45.51 | |
| DictaLM-3.0-Nemotron-12B-InstructSize Category=Smaller (~12B)2026.02 | 45.18 | |
| gemma-3-12b-itSize Category=Smaller (~12B)2026.02 | 44.85 | |
| Qwen3-14B (think)Size Category=Smaller (~12B), Reasoning Mode=Thinking2026.02 | 41.86 | |
| DictaLM-3.0-1.7B-ThinkingSize Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 31.23 | |
| DictaLM-3.0-1.7B-InstructSize Category=Tiny (~1.7B)2026.02 | 30.21 | |
| gemma-3-1b-itSize Category=Tiny (~1.7B)2026.02 | 26.58 | |
| Qwen3-1.7B (think)Size Category=Tiny (~1.7B), Reasoning Mode=Thinking2026.02 | 21.59 |