Multiple Choice Question Answering on MMLU, Social IQa, and NormAd-Eti baseline (overall)
73.668Mean AccuracyQwen2.5-14B-Instruct
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Qwen2.5-14B-InstructModel Family=Qwen, Parameters=14B2026.07 | 73.668 | 1.433 | 1.623 | 4.812 | 52.828 | |
| Qwen2.5-7B-InstructModel Family=Qwen, Parameters=7B2026.07 | 67.771 | 0.963 | 0.972 | 4.539 | 57.688 | |
| Llama-3.1-8B-InstructModel Family=Llama, Parameters=8B2026.07 | 63.287 | 2.647 | 2.999 | 5.784 | 78.293 | |
| Qwen2.5-1.5B-InstructModel Family=Qwen, Parameters=1.5B2026.07 | 43.714 | 5.826 | 6.586 | 14.305 | 98.576 | |
| Llama-3.2-1B-InstructModel Family=Llama, Parameters=1B2026.07 | 35.101 | 3.589 | 3.697 | 18.791 | 99.96 |