Preference Optimization on Helpful Assistant
53Helpfulness ScoreMOPO-Lag
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MOPO-LagModel=Zephyr-7b-beta2025.05 | 53 | 51 | 52 | |
| MOPO-LBModel=Zephyr-7b-beta2025.05 | 51 | 52 | 49 | |
| MOPO-LagModel=Llama-3.1-8B2025.05 | 48 | 46 | 45 | |
| PARMModel=Mistral-7b-v0.2 (Instruct)2025.05 | 48 | 47 | 41 | |
| MOPO-LBModel=Llama-3.1-8B2025.05 | 45 | 43 | 42 | |
| MOPO-LagModel=Mistral-7b-v0.2 (Instruct)2025.05 | 45 | 47 | 49 | |
| PARMModel=Zephyr-7b-beta2025.05 | 45 | 48 | 48 | |
| RiCModel=Mistral-7b-v0.2 (Instruct)2025.05 | 44 | 41 | 43 | |
| MOPO-LBModel=Mistral-7b-v0.2 (Instruct)2025.05 | 44 | 45 | 49 | |
| MOPO-LagModel=OpenChat-v3.52025.05 | 43 | 41 | 42 | |
| RiCModel=Zephyr-7b-beta2025.05 | 43 | 46 | 45 | |
| MOPO-LBModel=OpenChat-v3.52025.05 | 41 | 39 | 40 | |
| RiCModel=Llama-3.1-8B2025.05 | 41 | 47 | 43 | |
| MODPOModel=Mistral-7b-v0.2 (Instruct)2025.05 | 41 | 39 | 40 | |
| RiCModel=OpenChat-v3.52025.05 | 40 | 33 | 37 | |
| PARMModel=Llama-3.1-8B2025.05 | 40 | 42 | 35 | |
| PARMModel=OpenChat-v3.52025.05 | 38 | 37 | 36 | |
| MODPOModel=OpenChat-v3.52025.05 | 35 | 33 | 39 | |
| MODPOModel=Zephyr-7b-beta2025.05 | 35 | 33 | 40 | |
| DPO on DJModel=Zephyr-7b-beta2025.05 | 34 | 38 | 38 | |
| MODPOModel=Llama-3.1-8B2025.05 | 32 | 33 | 37 | |
| DPO on DJModel=Mistral-7b-v0.2 (Instruct)2025.05 | 32 | 30 | 36 | |
| DPO on DJModel=Llama-3.1-8B2025.05 | 31 | 30 | 35 | |
| MOPO-LagModel=phi-1.52025.05 | 29 | 26 | 37 | |
| PARMModel=phi-1.52025.05 | 28 | 24 | 33 | |
| DPO on DJModel=OpenChat-v3.52025.05 | 28 | 26 | 36 | |
| MOPO-LBModel=phi-1.52025.05 | 27 | 24 | 34 | |
| RiCModel=phi-1.52025.05 | 23 | 21 | 31 | |
| DPO on DJModel=phi-1.52025.05 | 22 | 19 | 27 | |
| MODPOModel=phi-1.52025.05 | 21 | 20 | 25 |