XR-EmbodiedPlanning on XR-Scene 1.0 (test)
63.08CIDErLSceneLLM
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LSceneLLMEvaluation Protocol=Finetuning2024.12 | 63.08 | 22.97 | 36.96 | |
| Chat-SceneEvaluation Protocol=Finetuning, Input Modalities=Images and Point Clouds2024.12 | 46.18 | 22.34 | 36.71 | |
| LeoEvaluation Protocol=Finetuning, Object Identification=No2024.12 | 39.45 | 18.99 | 33.31 | |
| Ll3daEvaluation Protocol=Finetuning2024.12 | 35.96 | 15.74 | 31.5 | |
| Chat-SceneEvaluation Protocol=Zero-Shot, Input Modalities=Images and Point Clouds2024.12 | 32.64 | 20.71 | 10.26 | |
| LeoEvaluation Protocol=Zero-Shot, Object Identification=No2024.12 | 9.74 | 16.84 | 6.88 | |
| Ll3daEvaluation Protocol=Zero-Shot2024.12 | 7.02 | 15.21 | 7.17 |