Multimodal Compositional QA on SQA3D (test)
41AccuracyUnified QA
Evaluation results
| Method | Links | |
|---|---|---|
| Unified QAModality=P, Total Params.=11.0B, Zero-shot=true2024.02 | 41 | |
| GPT-3Modality=P, Total Params.=175.0B, Zero-shot=true2024.02 | 41 | |
| CREMAModality=V, P, Total Params.=4.1B, Zero-shot=true2024.02 | 40 | |
| CREMAModality=V, Total Params.=4.1B, Zero-shot=true2024.02 | 39.6 | |
| OneLLMModality=V, Total Params.=7.8B, Zero-shot=true2024.02 | 39.4 | |
| OneLLMModality=V, P, Total Params.=7.8B, Zero-shot=true2024.02 | 37.9 | |
| CREMAModality=P, Total Params.=3.1B, Zero-shot=true2024.02 | 37.3 | |
| 3D-LLMModality=P, Total Params.=3.1B, Zero-shot=true2024.02 | 36.9 | |
| OneLLMModality=P, Total Params.=7.8B, Zero-shot=true2024.02 | 34.5 |