Reddit Summary Alignment on Reddit Summary normalized rewards (test)
0.55Faithfulness RewardPARM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PARMModel=Llama-3.1-8B2025.12 | 0.55 | 0.44 | — | |
| MOPO-LagModel=Zephyr-7b-beta2025.12 | 0.55 | 0.6 | — | |
| PARMModel=Zephyr-7b-beta2025.12 | 0.53 | 0.56 | — | |
| MOPO-LagModel=Llama-3.1-8B2025.12 | 0.52 | 0.54 | — | |
| MOPO-LBModel=Zephyr-7b-beta2025.12 | 0.51 | 0.55 | — | |
| MOPO-LBModel=OpenChat-v3.52025.12 | 0.5 | 0.63 | — | |
| MOPO-LBModel=Llama-3.1-8B2025.12 | 0.5 | — | 0.52 | |
| MOPO-LagModel=OpenChat-v3.52025.12 | 0.49 | 0.61 | — | |
| MOPO-LBModel=Llama-3.1-8B2025.12 | 0.49 | 0.51 | — | |
| PARMModel=phi-1.52025.12 | 0.49 | — | 0.47 | |
| MOPO-LagModel=Llama-3.1-8B2025.12 | 0.49 | — | 0.5 | |
| MODPOModel=OpenChat-v3.52025.12 | 0.48 | 0.51 | — | |
| RiCModel=Zephyr-7b-beta2025.12 | 0.48 | 0.5 | — | |
| PARMModel=Llama-3.1-8B2025.12 | 0.48 | — | 0.49 | |
| PARMModel=OpenChat-v3.52025.12 | 0.47 | 0.6 | — | |
| DPO on D_JModel=OpenChat-v3.52025.12 | 0.47 | 0.52 | — | |
| MOPO-LBModel=phi-1.52025.12 | 0.47 | — | 0.44 | |
| MODPOModel=Llama-3.1-8B2025.12 | 0.46 | 0.46 | — | |
| MOPO-LagModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.46 | 0.48 | — | |
| MODPOModel=Llama-3.1-8B2025.12 | 0.46 | — | 0.48 | |
| PARMModel=Zephyr-7b-beta2025.12 | 0.46 | — | 0.52 | |
| MOPO-LBModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.45 | 0.47 | — | |
| MOPO-LagModel=phi-1.52025.12 | 0.45 | — | 0.47 | |
| MODPOModel=Zephyr-7b-beta2025.12 | 0.44 | 0.43 | — | |
| MOPO-LBModel=OpenChat-v3.52025.12 | 0.44 | — | 0.46 | |
| RiCModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.44 | — | 0.46 | |
| RiCModel=Zephyr-7b-beta2025.12 | 0.44 | — | 0.48 | |
| MOPO-LagModel=Zephyr-7b-beta2025.12 | 0.44 | — | 0.5 | |
| RiCModel=OpenChat-v3.52025.12 | 0.43 | 0.55 | — | |
| MODPOModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.43 | 0.43 | — | |
| DPO on D_JModel=Zephyr-7b-beta2025.12 | 0.43 | 0.41 | — | |
| RiCModel=OpenChat-v3.52025.12 | 0.43 | — | 0.4 | |
| MOPO-LBModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.43 | — | 0.45 | |
| MOPO-LBModel=Zephyr-7b-beta2025.12 | 0.43 | — | 0.48 | |
| RiCModel=Llama-3.1-8B2025.12 | 0.42 | 0.4 | — | |
| PARMModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.42 | 0.43 | — | |
| MOPO-LagModel=OpenChat-v3.52025.12 | 0.42 | — | 0.44 | |
| PARMModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.42 | — | 0.43 | |
| MOPO-LagModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.42 | — | 0.45 | |
| PARMModel=phi-1.52025.12 | 0.41 | 0.39 | — | |
| RiCModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.41 | 0.45 | — | |
| RiCModel=Llama-3.1-8B2025.12 | 0.41 | — | 0.4 | |
| MOPO-LBModel=phi-1.52025.12 | 0.4 | 0.46 | — | |
| DPO on D_JModel=Llama-3.1-8B2025.12 | 0.4 | 0.39 | — | |
| DPO on D_JModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.4 | 0.39 | — | |
| PARMModel=OpenChat-v3.52025.12 | 0.4 | — | 0.39 | |
| MODPOModel=Zephyr-7b-beta2025.12 | 0.4 | — | 0.39 | |
| MOPO-LagModel=phi-1.52025.12 | 0.39 | 0.42 | — | |
| MODPOModel=OpenChat-v3.52025.12 | 0.39 | — | 0.41 | |
| DPO on D_JModel=Llama-3.1-8B2025.12 | 0.39 | — | 0.39 | |
| MODPOModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.38 | — | 0.37 | |
| RiCModel=phi-1.52025.12 | 0.37 | 0.4 | — | |
| DPO on D_JModel=OpenChat-v3.52025.12 | 0.37 | — | 0.35 | |
| RiCModel=phi-1.52025.12 | 0.36 | — | 0.39 | |
| DPO on D_JModel=Zephyr-7b-beta2025.12 | 0.36 | — | 0.36 | |
| MODPOModel=phi-1.52025.12 | 0.35 | 0.34 | — | |
| DPO on D_JModel=phi-1.52025.12 | 0.35 | 0.35 | — | |
| DPO on D_JModel=Mistral-7b-vo.2 (Instruct)2025.12 | 0.35 | — | 0.36 | |
| DPO on D_JModel=phi-1.52025.12 | 0.34 | — | 0.31 | |
| MODPOModel=phi-1.52025.12 | 0.3 | — | 0.31 |