Fire safety query answering on Geometry-related fire safety queries Design-stage, Rule Requirement
72CorrectnessSGR-BIM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SGR-BIM2026.06 | 72 | 13.2 | 14.8 | 78.6 | |
| Enhanced-tool agent2026.06 | 65.6 | 9.5 | 24.9 | 70.4 | |
| Camel Baseline2026.06 | 60.8 | 10.6 | 28.6 | 66.1 | |
| Autogen Baseline2026.06 | 50.3 | 19 | 30.7 | 59.8 | |
| metaGPT Baseline2026.06 | 27.5 | 45.5 | 27 | 50.3 | |
| Basic-tool agent2026.06 | 0 | 16.4 | 83.6 | 8.2 |