Semantic Verifier Evaluation on SceneCritic
82.6Semantic ScoreDeepSeek-3.2V
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeepSeek-3.2VRefinement Variant=Heuristic2026.04 | 82.6 | 64.4 | 95.3 | 95.7 | 80.83 | |
| DeepSeek-3.2VRefinement Variant=LLM2026.04 | 78.9 | 62.8 | 97.1 | 96.9 | 79.57 | |
| Gemini-2.5-flashRefinement Variant=Image2026.04 | 78.7 | 55.8 | 97.5 | 96.6 | 77.18 | |
| Qwen3-235BRefinement Variant=LLM2026.04 | 76.9 | 54.6 | 96.5 | 95.7 | 75.87 | |
| Gemini-2.5-flashRefinement Variant=Img+Text2026.04 | 76.7 | 48.4 | 95.7 | 96.3 | 73.7 | |
| Gemini-2.5-flashRefinement Variant=Heuristic2026.04 | 76.3 | 43.7 | 99.3 | 98.9 | 73.03 | |
| Gemini-2.5-flashRefinement Variant=Sem+Text2026.04 | 75.8 | 53 | 98.6 | 98.6 | 75.8 | |
| Qwen3-235BRefinement Variant=Heuristic2026.04 | 75 | 47.1 | 98.2 | 97.8 | 73.37 | |
| Gemini-2.5-flashRefinement Variant=LLM2026.04 | 74.2 | 50.7 | 98.3 | 98.4 | 74.42 | |
| Qwen3-14BRefinement Variant=Heuristic2026.04 | 73.4 | 44.6 | 91.4 | 91.8 | 69.87 | |
| Qwen3-14BRefinement Variant=LLM2026.04 | 73.3 | 49.2 | 93.4 | 93.4 | 71.97 | |
| VL-Reasoner-72BRefinement Variant=LLM2026.04 | 72.8 | 47.4 | 91 | 91 | 70.4 | |
| VL-Reasoner-72BRefinement Variant=Sem+Text2026.04 | 72.8 | 50.2 | 88.2 | 88.4 | 70.43 | |
| LLaMA4 MaverickRefinement Variant=Heuristic2026.04 | 72.6 | 48.7 | 95.3 | 94.1 | 72 | |
| UI-Venus-Navi-72BRefinement Variant=LLM2026.04 | 72.6 | 45 | 89.6 | 89.6 | 69.07 | |
| Qwen2.5-72B-VLRefinement Variant=LLM2026.04 | 72.5 | 48.6 | 89.5 | 89.3 | 70.17 | |
| VL-Reasoner-72BRefinement Variant=Img+Text2026.04 | 72.4 | 44.1 | 91.1 | 90.9 | 69.17 | |
| Qwen2.5-72B-VLRefinement Variant=Sem+Text2026.04 | 72.3 | 44.6 | 90.4 | 89.9 | 69.02 | |
| Qwen2.5-72B-VLRefinement Variant=Heuristic2026.04 | 72.2 | 48.1 | 91.3 | 91.3 | 70.53 | |
| UI-Venus-Navi-72BRefinement Variant=Image2026.04 | 72.2 | 49.1 | 87.7 | 87.1 | 69.57 | |
| UI-Venus-Navi-72BRefinement Variant=Img+Text2026.04 | 72 | 51.8 | 90.8 | 90.6 | 71.5 | |
| Qwen2.5-72B-VLRefinement Variant=Image2026.04 | 71.2 | 49.1 | 89 | 88.2 | 69.63 | |
| VL-Reasoner-72BRefinement Variant=Image2026.04 | 71 | 44 | 87.2 | 87.2 | 67.4 | |
| Qwen2.5-72B-VLRefinement Variant=Img+Text2026.04 | 71 | 41.8 | 89.4 | 89 | 67.33 | |
| UI-Venus-Navi-72BRefinement Variant=Sem+Text2026.04 | 70.7 | 48.6 | 90.2 | 90.3 | 69.85 | |
| LLaMA4 MaverickRefinement Variant=LLM2026.04 | 69.9 | 44.7 | 89.9 | 89.5 | 68.1 | |
| VL-Reasoner-72BRefinement Variant=Heuristic2026.04 | 68.9 | 42.1 | 95.6 | 95.4 | 68.83 | |
| Holo1.5-72BRefinement Variant=Image2026.04 | 68.5 | 50.2 | 84.8 | 85.1 | 67.88 | |
| Qwen3-14B-Intuitor-MATH-1EPOCHRefinement Variant=LLM2026.04 | 68.4 | 43.3 | 82.6 | 82.7 | 64.78 | |
| Holo1.5-72BRefinement Variant=Heuristic2026.04 | 68.3 | 48.7 | 90 | 90 | 69 | |
| Qwen2.5-14B-GRPORefinement Variant=LLM2026.04 | 67.9 | 50.7 | 86.2 | 86.6 | 68.33 | |
| Holo1.5-72BRefinement Variant=Img+Text2026.04 | 67.9 | 49.1 | 83.6 | 84.3 | 66.98 | |
| Holo1.5-72BRefinement Variant=Sem+Text2026.04 | 67.6 | 45.8 | 77.3 | 77.8 | 63.65 | |
| Qwen2.5-14B-GRPORefinement Variant=Heuristic2026.04 | 67.3 | 46.6 | 85.2 | 85.6 | 66.43 | |
| Holo1.5-72BRefinement Variant=LLM2026.04 | 66.9 | 42.1 | 80.9 | 81.4 | 63.38 | |
| UI-Venus-Navi-72BRefinement Variant=Heuristic2026.04 | 66.5 | 36.6 | 91.7 | 91.7 | 64.93 | |
| Qwen3-14B-Intuitor-MATH-1EPOCHRefinement Variant=Heuristic2026.04 | 65.8 | 34.3 | 87.4 | 87.9 | 62.58 | |
| Qwen2.5-VL-7B-MM-RLHFRefinement Variant=LLM2026.04 | 65.5 | 56.9 | 90.4 | 90.6 | 70.97 | |
| Qwen2.5-VL-7B-MM-RLHFRefinement Variant=Heuristic2026.04 | 64 | 47.6 | 88.3 | 88.7 | 66.7 | |
| Qwen3-14B-GRPO-MATH-1EPOCHRefinement Variant=Heuristic2026.04 | 63.8 | 65.1 | 86.2 | 87.4 | 71.9 | |
| Qwen3-14B-GRPO-MATH-1EPOCHRefinement Variant=LLM2026.04 | 63.8 | 65.5 | 68.2 | 68.9 | 65.95 |