Visual Counting on Penguin benchmark
17.07MAECountGD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CountGD2024.12 | 17.07 | — | 25.08 | — | |
| GroundingREC2024.12 | 22.04 | — | 26.75 | — | |
| DAVEprm2024.12 | 22.29 | — | 31.38 | — | |
| LVLM-CountVariant=Main, Backbone=GPT-4o2024.12 | 26.76 | — | 38.6 | — | |
| LVLM-CountBackbone=GPT-4o2024.12 | 26.76 | — | 38.6 | 8.42 | |
| LVLM-CountVariant=Main, Backbone=Qwen22024.12 | 28.21 | — | 40.4 | — | |
| LVLM-CountBackbone=Qwen2 VL 72B AWQ2024.12 | 28.21 | — | 40.4 | 15.81 | |
| LVLM-CountVariant=SAM-only, Backbone=GPT-4o2024.12 | 29.02 | — | 44.89 | — | |
| LVLM-CountVariant=SAM-only, Backbone=Qwen22024.12 | 33.33 | — | 47.55 | — | |
| LVLM-CountVariant=Main, Backbone=Gemma 32024.12 | 34.13 | — | 44.11 | — | |
| LVLM-CountBackbone=Gemma 3 27B2024.12 | 34.13 | — | 44.11 | 15.31 | |
| GPT-4oBackbone=GPT-4o2024.12 | 35.18 | — | 45.76 | — | |
| GPT4o2024.12 | 35.18 | — | 45.76 | — | |
| LVLM-CountVariant=SAM-only, Backbone=Gemma 32024.12 | 41.09 | — | 53.01 | — | |
| Qwen2 VL 72B AWQBackbone=Qwen2 VL 72B AWQ2024.12 | 44.02 | — | 65.59 | — | |
| Qwen2 VL 72B AWQ2024.12 | 44.02 | — | 65.59 | — | |
| Gemma 3 27BBackbone=Gemma 3 27B2024.12 | 49.44 | — | 60.2 | — | |
| Gemma 3 27B2024.12 | 49.44 | — | 60.2 | — | |
| TFOC2024.12 | 59.34 | — | 74.4 | — |