Reward Modeling on RM-Bench (full)
83Chat ScoreCodeScaler
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CodeScalerModel size=8B2026.02 | 83 | 79.9 | 76.9 | 96.4 | 92.5 | 87.9 | 71.8 | 84.1 | |
| SkyworkRMModel size=8B2026.02 | 80.6 | 75 | 73.6 | 96.5 | 91.8 | 85.5 | 67 | 81.4 | |
| AceCodeRMModel size=32B2026.02 | 73.7 | 70.5 | 72.1 | 88 | 78.3 | 78.3 | 65.5 | 76.1 | |
| Nemotron-4-340B-RewardType=Generative2025.01 | 71.2 | 59.8 | 59.4 | 87.5 | 81 | 71.4 | 56.1 | 69.5 | |
| URM-LLaMa-3.1-8BType=Seq.2025.01 | 71.2 | 61.8 | 54.1 | 93.1 | 84 | 73.2 | 53 | 70 | |
| Skyword-Reward-Llama3.1-8BType=Seq.2025.01 | 69.5 | 60.6 | 54.5 | 95.7 | 89 | 74.7 | 46.6 | 70.1 | |
| AceCodeRMModel size=7B2026.02 | 66.7 | 65.3 | 66.9 | 89.9 | 79.9 | 74.4 | 62.2 | 72.2 | |
| Tulu-2-dpo-13bType=Implicit2025.01 | 66.4 | 51.4 | 51.8 | 85.4 | 86.9 | 66.7 | 37.7 | 63.8 | |
| IXC-2.5-RewardType=Seq.2025.01 | 65.5 | 55.9 | 51.7 | 93.8 | 87.5 | 71.3 | 47.4 | 68.8 | |
| InternLM2-20B-RewardType=Seq.2025.01 | 63.1 | 66.8 | 56.7 | 86.5 | 82.6 | 71.6 | 50.7 | 68.3 | |
| InternLM2-7B-RewardType=Seq.2025.01 | 61.7 | 71.4 | 49.7 | 85.5 | 85.4 | 70.7 | 45.1 | 67.1 |