Science Question Answering on ARC-C German (test)
91AccuracyTrinity Large (MoE)
Evaluation results
| Method | Links | |
|---|---|---|
| Trinity Large (MoE)evaluation_mode=Zero-shot, architecture=MoE2026.02 | 91 | |
| Qwen3 8Bevaluation_mode=Zero-shot, parameters=8B2026.02 | 87 | |
| Qwen3 4Bevaluation_mode=Zero-shot, parameters=4B2026.02 | 85 | |
| Datology 8Bevaluation_mode=Zero-shot, parameters=8B2026.02 | 71 | |
| Granite-4.0 Microevaluation_mode=Zero-shot2026.02 | 69 | |
| LFM2.5 1.2Bevaluation_mode=Zero-shot, parameters=1.2B2026.02 | 65 | |
| SmolLM3 3Bevaluation_mode=Zero-shot, parameters=3B2026.02 | 64 | |
| Llama-3.1 8Bevaluation_mode=Zero-shot, parameters=8B2026.02 | 63 | |
| Datology 3Bevaluation_mode=Zero-shot, parameters=3B2026.02 | 59 | |
| Llama-3.2 3Bevaluation_mode=Zero-shot, parameters=3B2026.02 | 50 | |
| Llama-3.2 1Bevaluation_mode=Zero-shot, parameters=1B2026.02 | 26 | |
| ArrowBase Model=Phi-2, Evaluation Setting=Zero-shot2025.05 | 24.83 | |
| GenKnowSubBase Model=Phi-2, Evaluation Setting=Zero-shot, Setting=En2025.05 | 24.55 | |
| Phi-2Base Model=Phi-2, Evaluation Setting=Zero-shot2025.05 | 23.84 | |
| GenKnowSubBase Model=Phi-2, Evaluation Setting=Zero-shot, Setting=Avg2025.05 | 23.49 |