Mathematical Reasoning on GSM8K (EMA, SIP, TAG, LAMP, BiSR Metrics)
46.9EMANon-split
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Non-splitBackbone=Qwen3-1.7B2026.06 | 46.9 | 76 | 78.2 | 74.3 | 84 | 74.4 | 83.9 | 42.4 | 34.7 | |
| DP-forwardBackbone=Qwen3-1.7B2026.06 | 46.7 | 57 | 56.5 | 74 | 83 | 73.6 | 83.5 | 39.8 | 35.9 | |
| DP-SGDBackbone=Qwen3-1.7B2026.06 | 46.1 | 73.8 | 77.6 | 74.2 | 83.9 | 74.3 | 83.7 | 41.8 | 34.4 | |
| Naive MixBackbone=Qwen3-1.7B2026.06 | 46.1 | 46.1 | 42.6 | 48.1 | 40.9 | 55.1 | 48.3 | 29.9 | 24.4 | |
| MIXGUARDBackbone=Qwen3-1.7B2026.06 | 45.5 | 4.2 | 2.4 | 30.3 | 34.9 | 27.2 | 30.5 | 10.6 | 6.6 | |
| Non-splitBackbone=Llama 3.2-1B2026.06 | 25.4 | 69.8 | 70 | 74.6 | 82.1 | 75.7 | 82.5 | 34.4 | 29.4 | |
| MIXGUARDBackbone=Llama 3.2-1B2026.06 | 23.6 | 3.7 | 2.6 | 30.3 | 34.6 | 27.3 | 30.5 | 17.4 | 14 | |
| DP-forwardBackbone=Llama 3.2-1B2026.06 | 23.2 | 58.5 | 56.6 | 74.8 | 82.2 | 75.6 | 82.6 | 35.7 | 29 | |
| Naive MixBackbone=Llama 3.2-1B2026.06 | 22.5 | 38.7 | 35.8 | 57.8 | 56.4 | 52.1 | 45 | 27.7 | 21.1 | |
| DP-SGDBackbone=Llama 3.2-1B2026.06 | 18.7 | 58.5 | 56.7 | 48.5 | 59.3 | 45 | 58.3 | 21.2 | 21 |