Judgment Consistency on CoinFlip (unseen)
51.8Baseline ScoreUNWAVERING-FQ (+ SFT + DPO)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| UNWAVERING-FQ (+ SFT + DPO)Type=O2023.10 | 51.8 | 18.2 | 35.14 | |
| Vicuna-7B + SFTType=L2023.10 | 51.4 | 18 | 35.02 | |
| UNWAVERING-FQ (+ SFT + DPO)Type=L2023.10 | 50.8 | 27.2 | 53.54 | |
| Vicuna-7B + SFTType=C2023.10 | 50.6 | 2.8 | 5.53 | |
| Vicuna-7B + SFTType=O2023.10 | 50.6 | 37.2 | 73.52 | |
| UNWAVERING-FQ (+ SFT + DPO)Type=C2023.10 | 50.4 | 0.2 | 0.4 | |
| Vicuna-7BType=C2023.10 | 50.2 | 0 | 0 | |
| Vicuna-7BType=O2023.10 | 49 | 49 | 100 | |
| Vicuna-7BType=L2023.10 | 48.6 | 17 | 34.98 |