Open-ended generation on CARE-pro
19.75Score (Seen)GRPO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GRPOBackbone=Gemma3-4b-it2026.05 | 19.75 | 17.25 | 18.92 | |
| LRPOBackbone=Gemma3-4b-it2026.05 | 19.26 | 16.84 | 18.45 | |
| DPOBackbone=Gemma3-4b-it2026.05 | 18.63 | 12.73 | 16.66 | |
| MAPOBackbone=Gemma3-4b-it2026.05 | 17.69 | 11.5 | 15.62 | |
| VanillaBackbone=Gemma3-4b-it2026.05 | 16.74 | 12.94 | 15.47 | |
| LIDRBackbone=Gemma3-4b-it2026.05 | 16.21 | 10.06 | 14.16 | |
| MPOBackbone=Gemma3-4b-it2026.05 | 15.41 | 10.47 | 13.76 | |
| LRPOBackbone=Qwen2.5-1.5b-it2026.05 | 12.36 | 1.23 | 8.65 | |
| DPOBackbone=Qwen2.5-1.5b-it2026.05 | 9.6 | 1.64 | 6.94 | |
| VanillaBackbone=Qwen2.5-1.5b-it2026.05 | 8.58 | 0.82 | 5.99 | |
| GRPOBackbone=Qwen2.5-1.5b-it2026.05 | 8.26 | 0.82 | 5.78 | |
| MPOBackbone=Qwen2.5-1.5b-it2026.05 | 6.58 | 1.03 | 4.73 | |
| LIDRBackbone=LLaMA3.2-1b-it2026.05 | 6.48 | 1.03 | 4.66 | |
| LIDRBackbone=Qwen2.5-1.5b-it2026.05 | 6.44 | 0.62 | 4.5 | |
| MAPOBackbone=Qwen2.5-1.5b-it2026.05 | 6.2 | 0.62 | 4.34 | |
| MPOBackbone=LLaMA3.2-1b-it2026.05 | 5.53 | 3.49 | 4.85 | |
| LRPOBackbone=LLaMA3.2-1b-it2026.05 | 3.96 | 3.08 | 3.66 | |
| VanillaBackbone=LLaMA3.2-1b-it2026.05 | 3.5 | 2.26 | 3.09 | |
| MAPOBackbone=LLaMA3.2-1b-it2026.05 | 3.5 | 2.46 | 3.15 | |
| DPOBackbone=LLaMA3.2-1b-it2026.05 | 3.01 | 1.64 | 2.55 | |
| GRPOBackbone=LLaMA3.2-1b-it2026.05 | 2.91 | 3.33 | 3.05 |