List your company

Multimodal Reward Modeling on MR2Bench Video

50.7Best-of-4 AccuracyMolmo2-4B Multi-response RM
36.03639.84343.6547.457Apr 13, 2026

Evaluation results

MethodLinks
Molmo2-4B Multi-response RMSize=4B2026.0450.7
GPT-52026.0450.1
Qwen3-VL-32BSize=32B2026.0449.9
Gemini-2.5-Pro2026.0449.7
Claude-Sonnet-4.52026.0449.1
IXC-2.5-RewardSize=7B2026.0448.7
Qwen3-VL-4BSize=4B2026.0447.9
Qwen3-VL-8BSize=8B2026.0447.7
InternVL3-78BSize=78B2026.0447.7
Qwen3-VL-4B Multi-response RMSize=4B2026.0447.5
Skywork-VL-RewardSize=7B2026.0446.7
R1-RewardSize=7B2026.0444.9
Qwen2.5-VL-7BSize=7B2026.0444.4
Molmo2-4BSize=4B2026.0443.2
Molmo2-8BSize=8B2026.0442.6
InternVL3-8BSize=8B2026.0440.4
LLaVA-CriticSize=7B2026.0440.2
MM-RLHF-RewardSize=7B2026.0436.6