Multi-task Language Understanding on MMLU Pro (Accuracy and Length)
57.6AccuracyRL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| RLBackbone=Qwen2.5-7B2025.06 | 57.6 | 954 | |
| ReLIFTBackbone=Qwen2.5-7B2025.06 | 56.4 | 2,173 | |
| SFTBackbone=Qwen2.5-7B2025.06 | 54.6 | 4,869 | |
| Qwen-7B-InstructBackbone=Qwen2.5-7B2025.06 | 53.1 | 3,325 | |
| ReLIFTBackbone=LLaMA-3.1-8B2025.06 | 44.2 | 650 | |
| RLBackbone=LLaMA-3.1-8B2025.06 | 39.4 | 549 | |
| LLaMa-8B-InstructBackbone=LLaMA-3.1-8B2025.06 | 38.1 | 357 | |
| Qwen-Math-1.5B-InstructBackbone=Qwen2.5-Math-1.5B2025.06 | 33.7 | 4,300 | |
| Qwen-7BBackbone=Qwen2.5-7B2025.06 | 32.8 | 945 | |
| ReLIFTBackbone=Qwen2.5-Math-1.5B2025.06 | 31.7 | 1,724 | |
| RLBackbone=Qwen2.5-Math-1.5B2025.06 | 31.4 | 1,075 | |
| SFTBackbone=LLaMA-3.1-8B2025.06 | 28.2 | 1,558 | |
| SFTBackbone=Qwen2.5-Math-1.5B2025.06 | 23.5 | 5,405 | |
| Qwen-Math-1.5BBackbone=Qwen2.5-Math-1.5B2025.06 | 5.2 | 1,982 |