Factual knowledge on Include Lite
41.88Seen AccuracyGRPO
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GRPOBackbone=Gemma3-4b-it2026.05 | 41.88 | 37.62 | 38.98 | |
| MPOBackbone=Gemma3-4b-it2026.05 | 41.67 | 37.71 | 38.97 | |
| LIDRBackbone=Gemma3-4b-it2026.05 | 41.38 | 37.69 | 38.87 | |
| LRPOBackbone=Gemma3-4b-it2026.05 | 41.1 | 37.18 | 38.43 | |
| VanillaBackbone=Gemma3-4b-it2026.05 | 41.05 | 37.41 | 38.56 | |
| MAPOBackbone=Gemma3-4b-it2026.05 | 40.94 | 37.35 | 38.49 | |
| DPOBackbone=Gemma3-4b-it2026.05 | 40.58 | 37.51 | 38.49 | |
| LRPOBackbone=Qwen2.5-1.5b-it2026.05 | 37.16 | 28.9 | 31.52 | |
| GRPOBackbone=Qwen2.5-1.5b-it2026.05 | 36 | 29.18 | 31.35 | |
| VanillaBackbone=Qwen2.5-1.5b-it2026.05 | 35.91 | 28.84 | 31.09 | |
| MPOBackbone=Qwen2.5-1.5b-it2026.05 | 35.62 | 29.1 | 31.17 | |
| DPOBackbone=Qwen2.5-1.5b-it2026.05 | 35.57 | 28.82 | 30.97 | |
| MAPOBackbone=Qwen2.5-1.5b-it2026.05 | 35.37 | 28.92 | 30.97 | |
| LIDRBackbone=Qwen2.5-1.5b-it2026.05 | 35.06 | 28.66 | 30.69 | |
| LRPOBackbone=LLaMA3.2-1b-it2026.05 | 29.67 | 27.47 | 28.17 | |
| DPOBackbone=LLaMA3.2-1b-it2026.05 | 29.66 | 27.14 | 27.94 | |
| GRPOBackbone=LLaMA3.2-1b-it2026.05 | 29.59 | 27.03 | 27.84 | |
| MAPOBackbone=LLaMA3.2-1b-it2026.05 | 29.57 | 27.22 | 27.97 | |
| LIDRBackbone=LLaMA3.2-1b-it2026.05 | 29.52 | 27.52 | 28.16 | |
| MPOBackbone=LLaMA3.2-1b-it2026.05 | 29.3 | 27.18 | 27.86 | |
| VanillaBackbone=LLaMA3.2-1b-it2026.05 | 29.28 | 27.17 | 27.84 |