Layout Generation on Residential BIM dataset (held-out)
82.4Mean NavigabilityDDEP
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DDEPModality=Domain-specific2025.12 | 82.4 | 98.2 | 89 | 18 | 3.2 | 3.18 | |
| Gemini 2.5 ProModality=Text-based2025.12 | 58 | 67.1 | 69 | 30 | 10.2 | 42.51 | |
| GPT-5 HighModality=VLM2025.12 | 57.8 | 58.3 | 67 | 27 | 12.1 | 124.18 | |
| Gemini 2.5 ProModality=VLM2025.12 | 54.6 | 73.2 | 67 | 34 | 11.9 | 43.16 | |
| GPT-5 MediumModality=VLM2025.12 | 54.3 | 55.5 | 65 | 29 | 12.3 | 164.43 | |
| Claude Sonnet 4.5Modality=VLM2025.12 | 52.7 | 44.9 | 64 | 32 | 23.7 | 18.71 | |
| GPT-5 MediumModality=Text-based2025.12 | 51.2 | 56.8 | 63 | 32 | 12.9 | 100.86 | |
| Qwen3Modality=VLM2025.12 | 48.7 | 75.9 | 60 | 33 | 12.4 | 439.04 | |
| LayoutVLMModality=Domain-specific2025.12 | 40.3 | — | 55 | 41 | 4.9 | 144.99 | |
| Qwen3Modality=Text-based2025.12 | 34 | 60.5 | 50 | 45 | 18.1 | 21.27 | |
| FlairGPTModality=Domain-specific2025.12 | 28.2 | 46.6 | 46 | 51 | 5 | 1,133.61 | |
| Claude Sonnet 4.5Modality=Text-based2025.12 | 2.1 | 34.1 | 26 | 69 | 33.3 | 18.02 |