ResearchBenchmarksReward Modeling on PKU BeavertailsFollow591,256Training SamplesRRM53,213.04192,897.27332,581.5472,265.73Jul 8, 2025Evaluation ResultsMethodMethodLinksTraining SamplesRRM2025.07591,256REFORM2025.0781,297Original reward2025.0773,907