Embodied Question Answering on MP3D-EQA v1 (test)
47.78Success Rate (SR)NaviLLM
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| NaviLLMGT Path=false, Evaluation Protocol=Zero-shot2023.12 | 47.78 | 35.6 | 44.5 | |
| DUET (R2R)GT Path=false, Evaluation Protocol=Zero-shot2023.12 | 47 | 30.51 | — | |
| DUET (REVERIE)GT Path=false, Evaluation Protocol=Zero-shot2023.12 | 39.22 | 11.47 | — | |
| DUET (SOON)GT Path=false, Evaluation Protocol=Zero-shot2023.12 | 17.43 | 3.91 | — | |
| EQA (habitat-lab)GT Path=true, Training Protocol=Fine-tuned2023.12 | — | — | 46 | |
| NaviLLMGT Path=true, Evaluation Protocol=Zero-shot2023.12 | — | — | 47.4 |