Machine Reading Comprehension on QA-Feedback (test)
44.9RelevanceLCO-KLD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LCO-KLDBackbone=Mistral-3-3B2026.03 | 44.9 | 67.3 | 62 | 58.1 | |
| PPOBackbone=Mistral-3-3B2026.03 | 43.1 | 61.4 | 53.1 | 52.5 | |
| SFTBackbone=Mistral-3-3B2026.03 | 42.7 | 58.9 | 51.3 | 51 | |
| π*Backbone=Mistral-3-3B2026.03 | 41.6 | 59.7 | 52.8 | 51.4 | |
| REINFORCEBackbone=Mistral-3-3B2026.03 | 41.6 | 62.9 | 53.6 | 52.7 | |
| ϕDPOBackbone=Mistral-3-3B2026.03 | 41.2 | 65.8 | 55.9 | 55.6 | |
| DAPOBackbone=Mistral-3-3B2026.03 | 41.2 | 62.5 | 52.8 | 52.2 | |
| GRPOBackbone=Mistral-3-3B2026.03 | 41 | 62.2 | 52.9 | 52 | |
| LCO-LCHBackbone=Mistral-3-3B2026.03 | 39.6 | 63.9 | 57.7 | 53.7 | |
| LCO-MSEBackbone=Mistral-3-3B2026.03 | 39.5 | 66.9 | 55.2 | 53.9 | |
| LCO-KLDBackbone=Llama-3.2-3B2026.03 | 39.2 | 81.7 | 61.2 | 60.7 | |
| GSPOBackbone=Mistral-3-3B2026.03 | 39.2 | 63.9 | 52.2 | 51.8 | |
| LCO-LCHBackbone=Llama-3.2-3B2026.03 | 38.3 | 81.4 | 54.3 | 58 | |
| LCO-MSEBackbone=Llama-3.2-3B2026.03 | 37.8 | 79.3 | 53.9 | 57 | |
| PPOBackbone=Llama-3.2-3B2026.03 | 37.4 | 62.7 | 50.7 | 50.3 | |
| ϕDPOBackbone=Llama-3.2-3B2026.03 | 36.9 | 73.7 | 54.9 | 55.2 | |
| SFTBackbone=Llama-3.2-3B2026.03 | 35.2 | 59.7 | 48.8 | 47.9 | |
| GRPOBackbone=Llama-3.2-3B2026.03 | 34.2 | 70.8 | 51.6 | 52.2 | |
| DAPOBackbone=Llama-3.2-3B2026.03 | 33.7 | 72.1 | 51.6 | 52.5 | |
| GSPOBackbone=Llama-3.2-3B2026.03 | 33.2 | 72.4 | 51.6 | 52.4 | |
| π*Backbone=Llama-3.2-3B2026.03 | 32.1 | 69.1 | 51.4 | 50.9 | |
| REINFORCEBackbone=Llama-3.2-3B2026.03 | 28 | 63.2 | 50.6 | 47.3 |