General Language Understanding and Reasoning on IFEval, BBH, MATH, GPQA, MUSR, MMLU-PRO
69.07IFEval ScoreRMiPO
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| RMiPOModel=LLama3-8B Instruct2026.04 | 69.07 | 29.01 | 8.96 | 3.5 | 8.41 | 30.46 | 24.9 | 1.83 | |
| ϵ-DPOModel=LLama3-8B Instruct2026.04 | 68.15 | 29.01 | 8.94 | 3.27 | 8.42 | 29.85 | 24.61 | 2.5 | |
| α-DPOModel=LLama3-8B Instruct2026.04 | 68.12 | 29.13 | 8.75 | 4.15 | 5.67 | 29.8 | 24.27 | 3 | |
| β-DPOModel=LLama3-8B Instruct2026.04 | 67.93 | 28.85 | 8.41 | 3.46 | 6.16 | 28.07 | 23.81 | 5 | |
| DPOModel=LLama3-8B Instruct2026.04 | 67.57 | 28.51 | 8.46 | 2.91 | 3.93 | 29.61 | 23.5 | 5.67 | |
| SimPERModel=LLama3-8B Instruct2026.04 | 65.91 | 27.97 | 8.74 | 5.91 | 4.15 | 28.67 | 23.56 | 4.67 | |
| SimPOModel=LLama3-8B Instruct2026.04 | 65.04 | 26.71 | 8.61 | 5.82 | 8.15 | 27.66 | 23.67 | 5.17 | |
| RMiPOModel=Mistral-7B Instruct2026.04 | 52.76 | 22.04 | 3.5 | 3.67 | 9.85 | 19.67 | 18.58 | 2.5 | |
| α-DPOModel=Mistral-7B Instruct2026.04 | 52.1 | 19.2 | 3.35 | 2.8 | 6.05 | 19.88 | 17.23 | 3.83 | |
| ϵ-DPOModel=Mistral-7B Instruct2026.04 | 52.05 | 17.25 | 3.5 | 2.85 | 6.88 | 19.75 | 17.05 | 3.83 | |
| β-DPOModel=Mistral-7B Instruct2026.04 | 51.95 | 17.05 | 3.27 | 2.74 | 8.91 | 19.84 | 17.29 | 4.67 | |
| DPOModel=Mistral-7B Instruct2026.04 | 51.76 | 16.88 | 3.1 | 2.46 | 5.75 | 19.43 | 16.56 | 6.33 | |
| SimPERModel=Mistral-7B Instruct2026.04 | 47.1 | 22.5 | 2.95 | 3.91 | 9.47 | 20.05 | 17.66 | 3 | |
| SimPOModel=Mistral-7B Instruct2026.04 | 46.87 | 22.38 | 2.87 | 3.8 | 9.76 | 19.96 | 17.61 | 3.67 |