Language Understanding on MMLU (full)
75.9Macro AccuracyQwen-2.5-7B-Instruct
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen-2.5-7B-InstructNumber of shots=10, temperature=02025.09 | 75.9 | |
| Qwen-2.5-7B-InstructNumber of shots=50, temperature=02025.09 | 75.8 | |
| Qwen-2.5-7BNumber of shots=10, temperature=02025.09 | 75.5 | |
| Qwen-2.5-7BNumber of shots=50, temperature=02025.09 | 75.4 | |
| MACHINELEARNINGLMNumber of shots=50, temperature=02025.09 | 75.4 | |
| MACHINELEARNINGLMNumber of shots=10, temperature=02025.09 | 75.1 | |
| Qwen-2.5-7B-InstructNumber of shots=0, temperature=02025.09 | 73.8 | |
| Qwen-2.5-7BNumber of shots=0, temperature=02025.09 | 73.5 | |
| MACHINELEARNINGLMNumber of shots=0, temperature=02025.09 | 73.2 | |
| TabuLa-8BNumber of shots=10, temperature=0, maximum sequence length=8k2025.09 | 65.2 | |
| TabuLa-8BNumber of shots=0, temperature=0, maximum sequence length=8k2025.09 | 61.6 |