XR Question Answering on XR-Scene 1.0 (test)
117.21CIDErLSceneLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LSceneLLMEvaluation Protocol=Finetuning2024.12 | 117.21 | 38.18 | 19.3 | |
| Chat-SceneEvaluation Protocol=Finetuning, Input Modalities=Images and Point Clouds2024.12 | 114.1 | 35.93 | 14.32 | |
| Ll3daEvaluation Protocol=Finetuning2024.12 | 112.8 | 36.94 | 18.68 | |
| LeoEvaluation Protocol=Finetuning, Object Identification=No2024.12 | 112.09 | 35.47 | 14.02 | |
| Chat-SceneEvaluation Protocol=Zero-Shot, Input Modalities=Images and Point Clouds2024.12 | 69.55 | 26.63 | 10.06 | |
| LeoEvaluation Protocol=Zero-Shot, Object Identification=No2024.12 | 55.4 | 22.71 | 6.96 | |
| Ll3daEvaluation Protocol=Zero-Shot2024.12 | 24.78 | 12.66 | 5.31 |