Visual Search on VisualProbe (test)
71.3Success Rate (Easy)SeProD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SeProDbase_method=Mini-o3, external_tool=false, prophet_model_size=7B2026.05 | 71.3 | 52.2 | 51.5 | |
| SeProDbase_method=Mini-o3, external_tool=false, prophet_model_size=3B2026.05 | 69.6 | 51.5 | 50.5 | |
| Qwen2.5-VL + BA-SFT + VanillaRLVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 69.5 | 36.57 | 42.45 | |
| Starve to PerceiveVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 68.09 | 34.7 | 43.4 | |
| Mini-o3external_tool=false2026.05 | 66.7 | 49 | 47.2 | |
| SeProDbase_method=DeepEyes, external_tool=false, prophet_model_size=3B2026.05 | 64.7 | 32.3 | 41.9 | |
| DeepEyesVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 63.83 | 35.07 | 32.07 | |
| SeProDbase_method=Pixel Reasoner, external_tool=false, prophet_model_size=3B2026.05 | 61.7 | 30.4 | 30.2 | |
| DeepEyesexternal_tool=false2026.05 | 61.2 | 30.5 | 38.4 | |
| Pixel Reasonerexternal_tool=false2026.05 | 58.7 | 29 | 28.7 | |
| PixelReasonerVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 58.4 | 29.6 | 28.8 | |
| Qwen2.5-VL + BA-SFT + VanillaRLVisual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 58.16 | 18.28 | 15.09 | |
| Starve to PerceiveVisual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 58.16 | 20.52 | 19.81 | |
| ChainOfFocusVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 56.74 | 32.46 | 38.67 | |
| Qwen2.5-VL + BA-SFTVisual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 49.64 | 32.46 | 33.97 | |
| Qwen2.5-VL + BA-SFTVisual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 47.51 | 19.78 | 14.15 | |
| GPT-4oVisual Bandwidth Constraint (B)=No Constrain, Reported From=Other publications2026.05 | 47.5 | 15.4 | 11.2 | |
| Qwen2.5-VLVisual Bandwidth Constraint (B)=No Constrain, Reported From=Other publications2026.05 | 39 | 26 | 23.9 | |
| ChainOfFocusVisual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 38.3 | 14.93 | 14.15 | |
| DeepEyesVisual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 37.58 | 13.43 | 15.09 | |
| Mini-o3Visual Bandwidth Constraint (B)=No Constrain, Tool-calling=True2026.05 | 19.86 | 25.37 | 19.81 | |
| Mini-o3Visual Bandwidth Constraint (B)=256, Tool-calling=True2026.05 | 17.02 | 17.54 | 0.9 |