Icon Grounding on A3-Dataset
70.1mAP@0.5 (Promotional Iconography)A3-Align
Evaluation results
| Method | Links | |
|---|---|---|
| A3-AlignModel Category=Ours, Thinking Mode=false2026.03 | 70.1 | |
| ChatGPT 5 highModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 28.3 | |
| Doubao 1.5 vision proModel Category=Closed-source Models, Thinking Mode=false2026.03 | 22.7 | |
| Qwen3-VL-32B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 17.2 | |
| Doubao 1.5 vision pro-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 15.1 | |
| Qwen3-VL-235B-A22B-thinkingModel Category=Open-source Models - Thinking, Thinking Mode=true2026.03 | 14.1 | |
| Qwen3-VL-32B-thinkingModel Category=Open-source Models - Thinking, Thinking Mode=true2026.03 | 11 | |
| Doubao seed 1.6-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 9.7 | |
| Glm-4.5v-106BModel Category=Open-source Models, Thinking Mode=false2026.03 | 6.9 | |
| Llama-4-Maverick-400BModel Category=Open-source Models, Thinking Mode=false2026.03 | 6.6 | |
| Claude Opus 4.1-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 3.7 | |
| Claude Opus 4.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 3.6 | |
| ChatGPT o4 mini highModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 3.6 | |
| ChatGPT o3Model Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 3.4 | |
| Qwen2.5-VL-72B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 3.2 | |
| Doubao seed 1.6 visionModel Category=Closed-source Models, Thinking Mode=false2026.03 | 3.2 | |
| Claude Sonnet 4.5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 3 | |
| Gemini 2.5 proModel Category=Closed-source Models, Thinking Mode=false2026.03 | 2.7 | |
| Claude Sonnet 4.5-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 2.4 | |
| Llama-4-Scout-109BModel Category=Open-source Models, Thinking Mode=false2026.03 | 1.9 | |
| Gemini 2.5 pro-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 1.9 | |
| ChatGPT 5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 1.3 | |
| Gemini 2.5 flashModel Category=Closed-source Models, Thinking Mode=false2026.03 | 1.3 | |
| Qwen3-VL-8B-InstructModel Category=Open-source Models, Thinking Mode=false2026.03 | 1.1 | |
| ChatGPT 4.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 0.8 | |
| Grok 4Model Category=Closed-source Models, Thinking Mode=false2026.03 | 0.2 | |
| Gemma-3-27B-itModel Category=Open-source Models, Thinking Mode=false2026.03 | 0.1 | |
| ChatGPT 4oModel Category=Closed-source Models, Thinking Mode=false2026.03 | 0.1 | |
| Claude Haiku 4.5Model Category=Closed-source Models, Thinking Mode=false2026.03 | 0.1 | |
| Claude Haiku 4.5-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 0.1 | |
| Mistral medium 3.1Model Category=Closed-source Models, Thinking Mode=false2026.03 | 0 | |
| Gemini 2.5 flash-thinkingModel Category=Closed-source Models - Thinking, Thinking Mode=true2026.03 | 0 |