Summarization on WikiHow (Reward & Baseline Comparison)
0.39Reward ScoreRL (Proposed)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RL (Proposed)Model=Granite-3.3-2B2026.03 | 0.39 | 17.17 | 5.69 | 22.88 | |
| StaticModel=Granite-3.3-2B2026.03 | 0.369 | — | — | — | |
| GreedyModel=Granite-3.3-2B2026.03 | 0.333 | — | — | — | |
| RL (Proposed)Model=Qwen-2.5-0.5B2026.03 | 0.204 | 78.95 | 45.71 | -43.6 | |
| StaticModel=Qwen-2.5-0.5B2026.03 | 0.14 | — | — | — | |
| GreedyModel=Qwen-2.5-0.5B2026.03 | 0.114 | — | — | — |