Summarization on SAMSum (MiniCheck, GEval)
0.523MiniCheck ScoreSCRPO
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SCRPOvariant=Full2025.12 | 0.523 | 4.42 | 4.56 | 4.75 | 2.96 | 4.6 | |
| SCRPOvariant=SFT2025.12 | 0.498 | 4.27 | 4.52 | 4.68 | 2.97 | 4.59 | |
| SCRPOvariant=Critique only2025.12 | 0.487 | 4.32 | 4.55 | 4.71 | 2.98 | 4.61 | |
| SCRPOvariant=Inference time2025.12 | 0.47 | 4.21 | 4.47 | 4.62 | 2.97 | 4.53 | |
| MPO2025.12 | 0.456 | 4.18 | 4.47 | 4.57 | 2.95 | 4.52 | |
| SCOPE2025.12 | 0.44 | 4.17 | 4.48 | 4.55 | 2.96 | 4.51 | |
| Pretrained LLM2025.12 | 0.437 | 4.17 | 4.49 | 4.57 | 2.97 | 4.54 |