Spatial Reasoning on WhatsUp-VLM VGQA (test)
0.984Accuracy(IA)3
Evaluation Results
| Method | Links | |
|---|---|---|
| (IA)3Backbone=Qwen2.5-VL-3B, Trainable Parameters=524.K2026.06 | 0.984 | |
| (IA)3Backbone=LLaVA-7B, Trainable Parameters=664.K2026.06 | 0.978 | |
| ScAle (attn)Backbone=Qwen2.5-VL-3B, Trainable Parameters=5762026.06 | 0.935 | |
| ScAle (attn)Backbone=LLaVA-7B, Trainable Parameters=1.02K2026.06 | 0.929 | |
| FrozenBackbone=Qwen2.5-VL-3B2026.06 | 0.845 | |
| FrozenBackbone=LLaVA-7B2026.06 | 0.565 |