Numerical Reasoning on GSM8K (test) (Error Magnitude Accuracy)
70Accuracy (Error <= 1)DEL
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DELBackbone=Qwen2.5-1.5B, Loss Function=Digit Entropy Loss2026.05 | 70 | 67 | 67.2 | 64.9 | 61.7 | 57 | |
| EMOBackbone=Qwen2.5-1.5B, Loss Function=EMO2026.05 | 69.3 | 64.1 | 66.3 | 66.4 | 59.6 | 54.5 | |
| NTLBackbone=Qwen2.5-1.5B, Loss Function=NTL2026.05 | 68.9 | 65.1 | 64.6 | 64.9 | 61.7 | 55.1 | |
| DIST2LossBackbone=Qwen2.5-1.5B, Loss Function=DIST2Loss2026.05 | 67.9 | 63.5 | 64.6 | 61.1 | 53.2 | 54.2 | |
| MLEBackbone=Qwen2.5-1.5B, Loss Function=MLE2026.05 | 66.8 | 62.4 | 63.7 | 66.4 | 61.7 | 54 | |
| MixCEBackbone=Qwen2.5-1.5B, Loss Function=MixCE2026.05 | 66.6 | 62.5 | 65.6 | 65.6 | 57.4 | 52.8 |