3D Question Answering on MMScan QA
55.4Overall ScoreLLaVA-3D
Evaluation Results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| LLaVA-3DSetting=Generalist2024.09 | 55.4 | 63.2 | 57.1 | 34.1 | 63.2 | 47.5 | 44.9 | 76.2 | 78.3 | 39.2 | 13.9 | 57.5 | 20.3 | 50.1 | 54.9 | |
| LEOSetting=Fine-tuning2024.09 | 47.8 | 55.5 | 49.5 | 36.1 | 45.6 | 32.1 | 38.4 | 71.2 | 72.2 | 32 | 12.5 | 52.1 | 17.7 | 36.6 | 44.5 | |
| LL3DASetting=Fine-tuning2024.09 | 38.5 | 40.4 | 46.2 | 14.7 | 47.1 | 26.4 | 7.1 | 65.3 | 67 | 26.4 | 8.5 | 44.3 | 14.7 | 30.2 | 37.6 | |
| 3D-LLMSetting=Zero-Shot2024.09 | 28.6 | 37.8 | 18.8 | 13.7 | 26.3 | 15.4 | 20.8 | 40.4 | 40.3 | 13.4 | 1.5 | 17.3 | 6 | 6.2 | 19.6 | |
| Chat3D-v2Setting=Zero-Shot2024.09 | 27.9 | 38.1 | 18.3 | 9.3 | 22.4 | 13.5 | 25.4 | 45.4 | 46.3 | 18 | 3 | 22.9 | 7.5 | 10.2 | 19.6 | |
| LEOSetting=Zero-Shot2024.09 | 22.2 | 28.9 | 17.6 | 18.1 | 20.4 | 15 | 16.3 | 40.4 | 41 | 11 | 0.7 | 17.1 | 4.9 | 9.6 | 18.7 | |
| LL3DASetting=Zero-Shot2024.09 | 15.8 | 15.5 | 14.7 | 14.2 | 25.2 | 4.3 | 6.4 | 40.7 | 43.6 | 5.4 | 2.1 | 16.4 | 4.4 | 8.3 | 19.4 |