Multi-turn Response Generation on MT-Bench (test)
5.71Turn 1 ScoreTLCR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TLCRreward_type=token-level (continuous)2024.07 | 5.71 | 4.38 | 5.04 | |
| ReMax2024.07 | 5.66 | 3.86 | 4.76 | |
| TLCRfixedreward_type=token-level (discrete)2024.07 | 5.47 | 4.3 | 4.89 | |
| PPOseqreward_type=sequence-level2024.07 | 5.29 | 4.08 | 4.68 | |
| FIGA2024.07 | 5.11 | 3.57 | 4.35 | |
| DPO2024.07 | 5.1 | 3.56 | 4.33 | |
| PPOsynthetictraining_data=synthetic2024.07 | 4.9 | 3.53 | 4.21 | |
| SFT2024.07 | 4.78 | 3.01 | 3.9 |