ResearchBenchmarksHelpfulness on HH-RLHF (test)Follow2.542RewardMAVIS2.086482.204742.3232.44126Aug 19, 2025Evaluation ResultsMethodMethodLinksRewardKL DivergenceMAVISModel Size=13BModel Size=13B2025.082.54224.11PPOModel Size=13BModel Size=13B2025.082.45224.19MAVISModel Size=7BModel Size=7B2025.082.31118.64PPOModel Size=7BModel Size=7B2025.082.10417.81