Summarization on TL;DR
92.8Win RateAlignDistil
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AlignDistilmode=Off-Policy2025.03 | 92.8 | 2.28 | |
| AlignDistilmode=On-Policy2025.03 | 92.5 | 2.46 | |
| RTO2025.03 | 90.8 | 1.98 | |
| PPO2025.03 | 87.7 | 2.22 | |
| DPO2025.03 | 85.7 | 1.67 | |
| SFT2025.03 | 50 | 0.55 |
| Method | Links | ||
|---|---|---|---|
| AlignDistilmode=Off-Policy2025.03 | 92.8 | 2.28 | |
| AlignDistilmode=On-Policy2025.03 | 92.5 | 2.46 | |
| RTO2025.03 | 90.8 | 1.98 | |
| PPO2025.03 | 87.7 | 2.22 | |
| DPO2025.03 | 85.7 | 1.67 | |
| SFT2025.03 | 50 | 0.55 |