Description Quality on Scene 2 Suite main room
79Color AccuracySpatialMem
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SpatialMemModel=SpatialMem (Our Model)2026.01 | 79 | 83 | 66 | |
| geminiModel=Google Gemini2026.01 | 76 | 81 | 69 | |
| internvlModel=InternVL 2.5, Deployment=Local, Entry=12026.01 | 74 | 79 | 67 | |
| llavaModel=LLaVA-Video, Deployment=Local2026.01 | 72 | 77 | 64 | |
| internvlModel=InternVL 2.5, Deployment=Local, Entry=22026.01 | 68 | 73 | 60 | |
| openaiModel=OpenAI GPT-4o2026.01 | 66 | 71 | 58 | |
| togetherModel=Qwen2.5-VL, Deployment=Cloud2026.01 | 62 | 66 | 54 | |
| qwen25vlModel=Qwen2.5-VL, Deployment=Local2026.01 | 55 | 59 | 47 |