Floor Plan Understanding on RPLAN (test)
100SuccessLLaVA-v1.6-Mistral-7B-HF
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LLaVA-v1.6-Mistral-7B-HFTime (s)=~62026.03 | 100 | 61.6 | 22.5 | 3.649 | 13.4 | 5.6 | |
| Qwen3-VL-8B-InstructTime (s)=~82026.03 | 100 | 69.8 | 34.7 | 5.837 | 38.2 | 12.8 | |
| InternVL3.5-8BTime (s)=~132026.03 | 100 | 84.7 | 54.6 | 12.234 | 46.9 | 15.7 | |
| HouseMind-UTime (s)=~32026.03 | 100 | 99.8 | 96.9 | 0.549 | 99 | 80.8 | |
| HouseMind-OTime (s)=~32026.03 | 100 | 99.8 | 92.5 | 0.655 | 95.4 | 73.8 | |
| MiniCPM-V 4.5Time (s)=~142026.03 | 99.6 | 90.4 | 49.2 | 13.765 | 59.7 | 20.8 |