Spatial Reasoning on SpatialEval Spatial-Grid (20% train)
92.2AccuracyLoRA-all
Evaluation Results
| Method | Links | |
|---|---|---|
| LoRA-allBackbone=Qwen2.5-VL-7B, Trainable Parameters=2.97M2026.06 | 92.2 | |
| (IA)3Backbone=Qwen2.5-VL-7B, Trainable Parameters=668.5K2026.06 | 91.9 | |
| (IA)3Backbone=Qwen2.5-VL-3B, Trainable Parameters=524.2K2026.06 | 91.7 | |
| LoRA-allBackbone=Qwen2.5-VL-3B, Trainable Parameters=2.32M2026.06 | 91.6 | |
| LoRA-allBackbone=LLaVA-13B, Trainable Parameters=4.06M2026.06 | 85.2 | |
| (IA)3Backbone=LLaVA-7B, Trainable Parameters=663.6K2026.06 | 84.8 | |
| (IA)3Backbone=LLaVA-13B, Trainable Parameters=1.01M2026.06 | 83.9 | |
| ScAle (attn)Backbone=Qwen2.5-VL-7B, Trainable Parameters=7842026.06 | 83.8 | |
| LoRA-lastBackbone=Qwen2.5-VL-7B, Trainable Parameters=90.1K2026.06 | 83.7 | |
| LoRA-allBackbone=LLaVA-7B, Trainable Parameters=2.65M2026.06 | 81.9 | |
| ScAle (attn)Backbone=Qwen2.5-VL-3B, Trainable Parameters=5762026.06 | 75.8 | |
| FrozenBackbone=Qwen2.5-VL-7B, Trainable Parameters=02026.06 | 73.7 | |
| LoRA-lastBackbone=Qwen2.5-VL-3B, Trainable Parameters=52.0K2026.06 | 68.8 | |
| ScAle (attn)Backbone=LLaVA-7B, Trainable Parameters=1.0K2026.06 | 68.6 | |
| FrozenBackbone=Qwen2.5-VL-3B, Trainable Parameters=02026.06 | 63.7 | |
| ScAle (attn)Backbone=LLaVA-13B, Trainable Parameters=1.6K2026.06 | 62 | |
| LoRA-lastBackbone=LLaVA-13B, Trainable Parameters=97.8K2026.06 | 43.5 | |
| FrozenBackbone=LLaVA-13B, Trainable Parameters=02026.06 | 36.7 | |
| FrozenBackbone=LLaVA-7B, Trainable Parameters=02026.06 | 29.3 | |
| LoRA-lastBackbone=LLaVA-7B, Trainable Parameters=78.1K2026.06 | 29.2 |