Spatial Relationship Understanding on VSR
73.9Overall AccuracyUniMRG
Evaluation results
| Method | Links | |
|---|---|---|
| UniMRGType=Unified, # LLM Params=2B2026.01 | 73.9 | |
| Emu3-ChatType=Und. Only, # LLM Params=8B2026.01 | 71.93 | |
| Janus-ProType=Unified, # LLM Params=7B2026.01 | 71.03 | |
| InternVL3Type=Und. Only, # LLM Params=2B2026.01 | 66.69 | |
| OpenUniType=Unified, # LLM Params=2B2026.01 | 66.69 | |
| UniLIPType=Unified, # LLM Params=2B2026.01 | 65.55 | |
| SGVLBackbone=BLIP22023.05 | 63.4 | |
| SGVLBackbone=BLIP2023.05 | 62.4 | |
| NegBLIP22023.05 | 62.1 | |
| BLIP22023.05 | 61.9 | |
| JanusType=Unified, # LLM Params=1.3B2026.01 | 61.37 | |
| HarmonType=Unified, # LLM Params=1.5B2026.01 | 60.88 | |
| NegBLIP2023.05 | 57.9 | |
| BLIP2023.05 | 56.5 | |
| Show-oType=Unified, # LLM Params=1.3B2026.01 | 54.26 | |
| FLAVA2023.05 | 54.1 | |
| LLaVA-OVType=Und. Only, # LLM Params=0.5B2026.01 | 51.47 |