General performance assessment on Overall Combined Benchmarks
49.64Performance (Seen Data)GRPO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GRPOBackbone=Gemma3-4b-it2026.05 | 49.64 | 38.83 | 46.67 | |
| LRPOBackbone=Gemma3-4b-it2026.05 | 49.51 | 39.86 | 46.89 | |
| DPOBackbone=Gemma3-4b-it2026.05 | 48.9 | 38.05 | 46 | |
| MAPOBackbone=Gemma3-4b-it2026.05 | 48.76 | 38.08 | 45.86 | |
| VanillaBackbone=Gemma3-4b-it2026.05 | 48.67 | 38.23 | 45.8 | |
| LIDRBackbone=Gemma3-4b-it2026.05 | 48.26 | 37.46 | 45.29 | |
| MPOBackbone=Gemma3-4b-it2026.05 | 48.04 | 37.82 | 45.19 | |
| LRPOBackbone=Qwen2.5-1.5b-it2026.05 | 37.94 | 19.08 | 32.15 | |
| GRPOBackbone=Qwen2.5-1.5b-it2026.05 | 35.09 | 19.44 | 30.42 | |
| DPOBackbone=Qwen2.5-1.5b-it2026.05 | 33.55 | 19.22 | 29.33 | |
| VanillaBackbone=Qwen2.5-1.5b-it2026.05 | 32.86 | 18.54 | 28.64 | |
| MAPOBackbone=Qwen2.5-1.5b-it2026.05 | 32.47 | 18.52 | 28.4 | |
| MPOBackbone=Qwen2.5-1.5b-it2026.05 | 32.33 | 18.79 | 28.38 | |
| LIDRBackbone=Qwen2.5-1.5b-it2026.05 | 31.65 | 17.97 | 27.58 | |
| LRPOBackbone=LLaMA3.2-1b-it2026.05 | 24.27 | 18.48 | 22.29 | |
| MPOBackbone=LLaMA3.2-1b-it2026.05 | 24.09 | 17.61 | 21.86 | |
| GRPOBackbone=LLaMA3.2-1b-it2026.05 | 24 | 18.4 | 22.18 | |
| LIDRBackbone=LLaMA3.2-1b-it2026.05 | 23.97 | 17.52 | 21.69 | |
| DPOBackbone=LLaMA3.2-1b-it2026.05 | 23.81 | 18.19 | 21.76 | |
| MAPOBackbone=LLaMA3.2-1b-it2026.05 | 23.74 | 17.86 | 21.64 | |
| VanillaBackbone=LLaMA3.2-1b-it2026.05 | 23.5 | 17.22 | 21.36 |