Reward Modeling on EditReward-Bench
85.4PFJRM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| JRM2026.02 | 85.4 | — | 85.1 | |
| EditReward2026.02 | 83.2 | — | 79.2 | |
| EditRewardType=Disc.2026.02 | 83.2 | — | 79.2 | |
| GPT-52026.02 | 77.7 | 66.9 | 75.5 | |
| PaCo-Reward-7BParameters=7B2026.02 | 77.7 | 70.9 | 75.1 | |
| GPT-5Type=Closed, Pointwise VIEScore setting=true2026.02 | 77.7 | 66.9 | 75.5 | |
| GPT-5Type=Closed2026.06 | 77.7 | 66.9 | 75.5 | |
| EditScore-7B (Avg@4)Type=Gen.2026.06 | 72.2 | 72 | 72.7 | |
| Gemini-3.0-FlashVersion=3.0-Flash2026.02 | 71.7 | 66.2 | 76.9 | |
| Gemini-3.0-FlashType=Closed, Pointwise VIEScore setting=true2026.02 | 71.7 | 66.2 | 76.9 | |
| Gemini-3.0-FlashType=Closed2026.06 | 71.7 | 66.2 | 76.9 | |
| Gemini-2.5-ProVersion=2.5-Pro2026.02 | 70.3 | 56 | 72.2 | |
| Gemini-2.5-ProType=Closed, Pointwise VIEScore setting=true2026.02 | 70.3 | 56 | 72.2 | |
| Gemini-2.5-ProType=Closed2026.06 | 70.3 | 56 | 72.2 | |
| SpatialRewardType=Gen.2026.02 | 68.3 | 67.2 | 80.3 | |
| GPT-4.12026.02 | 67.3 | 60.2 | 70.5 | |
| GPT-4.1Type=Closed, Pointwise VIEScore setting=true2026.02 | 67.3 | 60.2 | 70.5 | |
| GPT-4.1Type=Closed2026.06 | 67.3 | 60.2 | 70.5 | |
| SFReward (Ours)Type=Gen.2026.06 | 64.8 | 62.1 | 76 | |
| EditScore-72BParameters=72B2026.02 | 63.8 | 58.6 | 70.3 | |
| w/o Dense Anno. (Ours)Type=Gen.2026.06 | 62.7 | 51.4 | 69.9 | |
| EditScore-8BParameters=8B2026.02 | 60.8 | 59.4 | 69 | |
| EditScore-8BType=Gen.2026.02 | 60.8 | 59.4 | 69 | |
| Qwen3-VL-8BType=Gen.2026.02 | 41.9 | 24.3 | 56.2 | |
| Qwen3-VL-8BType=Gen.2026.06 | 41.9 | 24.3 | 56.2 |