List your company
ResearchFormerly WizWand

Visual Understanding on MMStar

65.9Accuracy (Clean)MM-Eureka-Qwen-7B
29.042438.611248.1857.7488Sep 29, 2025Oct 12, 2025Oct 26, 2025Nov 8, 2025Nov 22, 2025Dec 5, 2025Dec 19, 2025
Updated 5mo ago

Evaluation results

MethodLinks
MM-Eureka-Qwen-7BBase Model=Qwen2.5-VL-7B2025.0965.9—————
VisionZero-Qwen-7B (Real-World)Base Model=Qwen2.5-VL-7B, Variant=Real-World2025.0965.8—————
VisionZero-Qwen-7B (CLEVR)Base Model=Qwen2.5-VL-7B, Variant=CLEVR2025.0965.2—————
VisionZero-Qwen-7B (Chart)Base Model=Qwen2.5-VL-7B, Variant=Chart2025.0964.7—————
Qwen2.5-VL-7B-InstructBase Model=Qwen2.5-VL-7B2025.0964.6—————
ViGaL-Snake+RotationBase Model=Qwen2.5-VL-7B2025.0962.6—————
VLAA-Thinker-7BBase Model=Qwen2.5-VL-7B2025.0960.4—————
OpenVLThinker-7BBase Model=Qwen2.5-VL-7B2025.0959.1—————
R1-OneVision-7BBase Model=Qwen2.5-VL-7B2025.0957.8—————
Robust-R1 (SFT and RL)Category=Ours, Training Mode=SFT and RL2025.1256.8654.453.649.53——
Robust-R1 (SFT)Category=Ours, Training Mode=SFT2025.1255.25351.8649.53——
Qwen2.5-VL-3BCategory=General MLLM2025.1254.7352.951.8648.66——
InternVL-4BCategory=General MLLM2025.1251.5350.2649.646.93——
Gemma3-4BCategory=General MLLM2025.1243.9343.242.641.33——
Robust CLIPCategory=Robust MLLM2025.123332.2631.829.46——
TeCoACategory=Robust MLLM2025.1230.4630.630.7328.06——
BaseTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————56.1
CoLVR2026.05————61.47—
CoT-SFTTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————57.1
GRPOTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————57.8
LVRSteps=82026.05————58.07—
Mirage2026.05————55.27—
Off-policy KDTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————57.4
OPDTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————59.7
PAPOTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————58
VA-OPDTeacher=Qwen3-VL-8B, Student=Qwen3-VL-2B, Training Data=Geometry3K, Temperature=1.0, Checkpoint Selection=Best checkpoint2026.05—————59.9