Preference Modeling on RewardBench 2
68.42FactualityHRC
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| HRCBase Model=LLAMA-3.1-8B, dim=2 + 12026.05 | 68.42 | 35 | 60.11 | 92.89 | 94.75 | 74.51 | 70.95 | |
| HRCBase Model=LLAMA-3.1-8B, dim=4 + 12026.05 | 68 | 32.5 | 61.2 | 92.67 | 95.15 | 74.51 | 70.67 | |
| GPMBase Model=LLAMA-3.1-8B, dim=42026.05 | 67.58 | 33.12 | 57.92 | 92.22 | 93.74 | 73.53 | 69.69 | |
| GPMBase Model=LLAMA-3.1-8B, dim=22026.05 | 66.53 | 33.75 | 62.3 | 92.22 | 94.14 | 71.57 | 70.08 | |
| BTBase Model=LLAMA-3.1-8B, dim=12026.05 | 64.63 | 34.38 | 64.48 | 92.67 | 90.91 | 73.53 | 70.1 | |
| HRCBase Model=GEMMA-2B-IT, dim=2 + 12026.05 | 47.58 | 35.63 | 61.75 | 82 | 79.6 | 39.22 | 57.63 | |
| GPMBase Model=GEMMA-2B-IT, dim=22026.05 | 47.16 | 33.75 | 62.84 | 78 | 71.92 | 38.24 | 55.32 | |
| HRCBase Model=GEMMA-2B-IT, dim=4 + 12026.05 | 45.89 | 33.75 | 62.3 | 83.78 | 77.78 | 39.22 | 57.12 | |
| BTBase Model=GEMMA-2B-IT, dim=12026.05 | 45.68 | 32.5 | 62.3 | 80.67 | 77.17 | 37.25 | 55.93 | |
| GPMBase Model=GEMMA-2B-IT, dim=42026.05 | 43.16 | 36.25 | 64.48 | 81.11 | 76.16 | 37.25 | 56.4 |