List your company
ResearchFormerly WizWand

Multimodal Reasoning on MMMU (FEI, AEI)

55.06FEI ScoreVRPRM-MiMo w/o RL & w/o CoT
29.73636.310542.88549.4595Aug 5, 2025
Updated 5mo ago

Evaluation results

MethodLinks
VRPRM-MiMo w/o RL & w/o CoT# Samples=3.6K, Explicit Reasoning (CoT)=false, RL Training=false2025.0855.0645.35
VRPRM-MiMo w/o CoT# Samples=53.6K, Explicit Reasoning (CoT)=false, RL Training=true2025.0854.3165.52
VRPRM-MiMo# Samples=53.6K, Explicit Reasoning (CoT)=true, RL Training=true2025.0853.1866.95
VRPRM-Qwen3# Samples=53.6K, Explicit Reasoning (CoT)=true, RL Training=true2025.0852.8165.78
VRPRM# Samples=53.6K, Explicit Reasoning (CoT)=true, RL Training=true2025.0852.0663.16
MiMo-VL-7B# Samples=unk2025.0850.9458.45
VRPRM-Qwen3 w/o RL & w/o CoT# Samples=3.6K, Explicit Reasoning (CoT)=false, RL Training=false2025.0850.5649.15
VRPRM-MiMo w/o RL# Samples=3.6K, Explicit Reasoning (CoT)=true, RL Training=false2025.0850.2657.63
Qwen3-VL-4B-Thinking# Samples=unk2025.0849.8158.07
VRPRM w/o RL & w/o CoT# Samples=3.6K, Explicit Reasoning (CoT)=false, RL Training=false2025.0849.0650.69
VRPRM w/o RL# Samples=3.6K, Explicit Reasoning (CoT)=true, RL Training=false2025.0847.5755.94
Qwen2.5-VL-72B# Samples=unk2025.0846.4451.31
VRPRM w/o CoT# Samples=53.6K, Explicit Reasoning (CoT)=false, RL Training=true2025.0846.4452.66
VRPRM-Qwen3 w/o CoT# Samples=53.6K, Explicit Reasoning (CoT)=false, RL Training=true2025.0846.4462.34
VRPRM-Qwen3 w/o RL# Samples=3.6K, Explicit Reasoning (CoT)=true, RL Training=false2025.0846.4454.37
Qwen2.5-VL-7B# Samples=unk2025.0844.5746.88
Gemini-2.0-Flash# Samples=unk2025.0843.0743.04
InternVL2.5-8B# Samples=unk2025.0841.6349.59
GPT-4o-mini# Samples=unk2025.0840.4535.27
VisualPRM-8B# Samples=400K2025.0830.7159.01