Mathematical Reasoning on MinervaMath (Conditional Local Accuracy, Overall Accuracy)
52.68AccuracyQwen2.5-Math-1.5B-Instruct
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen2.5-Math-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 52.68 | — | — | |
| DLLGModel scale=1.5B, Evaluation mode=0-shot2026.06 | 51.79 | — | — | |
| RouterDCModel scale=1.5B, Evaluation mode=0-shot2026.06 | 51.34 | — | — | |
| EmbedLLMModel scale=1.5B, Evaluation mode=0-shot2026.06 | 51.34 | — | — | |
| Entropy WeightingModel scale=1.5B, Evaluation mode=0-shot2026.06 | 48.66 | — | — | |
| UniTeModel scale=1.5B, Evaluation mode=0-shot2026.06 | 45.98 | — | — | |
| GaCModel scale=1.5B, Evaluation mode=0-shot2026.06 | 45.09 | — | — | |
| Pack of LLMsModel scale=1.5B, Evaluation mode=0-shot2026.06 | 44.64 | — | — | |
| Token Maj-VotingModel scale=1.5B, Evaluation mode=0-shot2026.06 | 38.39 | — | — | |
| Qwen2.5-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 30.36 | — | — | |
| LinearModel scale=1.5B, Evaluation mode=0-shot2026.06 | 25.45 | — | — | |
| Qwen2.5-Coder-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 24.55 | — | — | |
| SLERPModel scale=1.5B, Evaluation mode=0-shot2026.06 | 22.32 | — | — | |
| Task ArithmeticModel scale=1.5B, Evaluation mode=0-shot2026.06 | 11.61 | — | — | |
| Cloud LLM2025.09 | — | — | 80.9 | |
| Collaboration-Aware TuningModel=Qwen2.5-1.5B2025.09 | — | 13.6 | 33.5 | |
| Collaboration-Aware TuningModel=Llama-3.2-3B2025.09 | — | 13.4 | 36.8 | |
| OursModel=Qwen2.5-1.5B2025.09 | — | 24.1 | 40.8 | |
| OursModel=Llama-3.2-3B2025.09 | — | 27.7 | 43.4 | |
| Task-Tuning OnlyModel=Qwen2.5-1.5B2025.09 | — | 20.6 | 20.6 | |
| Task-Tuning OnlyModel=Llama-3.2-3B2025.09 | — | 19.1 | 19.1 | |
| Task-Tuning&Naive OffloadingModel=Qwen2.5-1.5B2025.09 | — | 21 | 38.2 | |
| Task-Tuning&Naive OffloadingModel=Llama-3.2-3B2025.09 | — | 19.4 | 37.1 | |
| Task-Tuning&RouterModel=Qwen2.5-1.5B2025.09 | — | 21.8 | 36.8 | |
| Task-Tuning&RouterModel=Llama-3.2-3B2025.09 | — | 20.2 | 39.1 |