Math Reasoning on mGSM v2
78Accuracy (Seen)GRPO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GRPOBackbone=Gemma3-4b-it2026.05 | 78 | 59.2 | 71.16 | |
| LRPOBackbone=Gemma3-4b-it2026.05 | 77.49 | 62.1 | 71.89 | |
| VanillaBackbone=Gemma3-4b-it2026.05 | 77.26 | 59.2 | 70.69 | |
| MAPOBackbone=Gemma3-4b-it2026.05 | 76.67 | 60.2 | 70.68 | |
| DPOBackbone=Gemma3-4b-it2026.05 | 76.34 | 58.9 | 70 | |
| LIDRBackbone=Gemma3-4b-it2026.05 | 76.23 | 58.9 | 69.93 | |
| MPOBackbone=Gemma3-4b-it2026.05 | 75.94 | 59.3 | 69.89 | |
| LRPOBackbone=Qwen2.5-1.5b-it2026.05 | 52.51 | 13.3 | 38.25 | |
| GRPOBackbone=Qwen2.5-1.5b-it2026.05 | 43.43 | 12.9 | 32.33 | |
| DPOBackbone=Qwen2.5-1.5b-it2026.05 | 37.33 | 14.64 | 27.02 | |
| MAPOBackbone=Qwen2.5-1.5b-it2026.05 | 36.8 | 12.24 | 25.64 | |
| VanillaBackbone=Qwen2.5-1.5b-it2026.05 | 35.73 | 11.84 | 24.87 | |
| MPOBackbone=Qwen2.5-1.5b-it2026.05 | 35.67 | 12.32 | 25.05 | |
| LIDRBackbone=Qwen2.5-1.5b-it2026.05 | 34.2 | 10.88 | 23.6 | |
| DPOBackbone=LLaMA3.2-1b-it2026.05 | 26 | 12.8 | 21.2 | |
| LRPOBackbone=LLaMA3.2-1b-it2026.05 | 25.31 | 12.2 | 20.55 | |
| MAPOBackbone=LLaMA3.2-1b-it2026.05 | 25.09 | 11.2 | 20.04 | |
| GRPOBackbone=LLaMA3.2-1b-it2026.05 | 24.91 | 14.8 | 21.24 | |
| MPOBackbone=LLaMA3.2-1b-it2026.05 | 24.51 | 9 | 18.87 | |
| LIDRBackbone=LLaMA3.2-1b-it2026.05 | 23.89 | 10.7 | 19.09 | |
| VanillaBackbone=LLaMA3.2-1b-it2026.05 | 23.66 | 8.7 | 18.22 |