Knowledge Evaluation on OALL v2
77.44AccuracyKarnak
Evaluation Results
| Method | Links | |
|---|---|---|
| KarnakSize=40B, Protocol=0-shot2026.03 | 77.44 | |
| Llama-3.3-70b-InstructSize=70B, Protocol=0-shot2026.03 | 73 | |
| Gemma-3-27B-itSize=27B, Protocol=0-shot2026.03 | 70.95 | |
| Fanar-27BSize=27B, Protocol=0-shot2026.03 | 69.4 | |
| Fanar-1-9b-instructSize=9B, Protocol=0-shot2026.03 | 68.64 | |
| AceGPT-v2-70B-ChatSize=70B, Protocol=0-shot2026.03 | 68.16 | |
| Allam-7B-Instruct-preview-v2Size=7B, Protocol=0-shot2026.03 | 67.98 | |
| AceGPT-v2-32B-ChatSize=32B, Protocol=0-shot2026.03 | 67.42 | |
| Qwen3-32BSize=32B, Protocol=0-shot2026.03 | 64.85 |