Vision-and-Language Navigation on RxR (Room-Across-Room) unseen (val)
69.2SR (Success Rate)P3Nav
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| P3Nav2026.03 | 69.2 | — | 0.702 | 0.591 | |
| BEVBert2026.03 | 68.5 | — | 0.696 | 0.586 | |
| GOAT2024.04 | 68.2 | 61.7 | 0.671 | 0.566 | |
| EnvEdit (on HAMT)Pre-trained=true, Single-run setting=true2022.03 | 62.8 | — | 0.685 | 54.6 | |
| EnvEdit2026.03 | 62.8 | — | 0.685 | 0.546 | |
| VLN-SIG2023.04 | 60 | — | 0.653 | 0.514 | |
| VLN-PETLUpdated Params(%)=1.672023.08 | 57.95 | 54.16 | 0.6494 | 0.497 | |
| VLN-PETL2024.04 | 57.9 | 54.2 | 0.649 | 0.497 | |
| Fine-TuningUpdated Params(%)=1002023.08 | 57.88 | 54.18 | 0.6452 | 0.4944 | |
| HAMTPre-trained=true, Single-run setting=true2022.03 | 56.5 | — | 0.631 | 48.3 | |
| HAMT2023.04 | 56.5 | — | 0.631 | 0.483 | |
| HAMT2026.03 | 56.5 | — | 0.631 | 0.483 | |
| AdapterUpdated Params(%)=1.902023.08 | 55.19 | 51.44 | 0.6356 | 0.4732 | |
| LoRAUpdated Params(%)=1.862023.08 | 54.53 | 51.14 | 0.6323 | 0.4694 | |
| MARM-MP2024.04 | 50.2 | — | 0.603 | 0.439 | |
| EnvEdit (on EnvDrop-CLIP)Pre-trained=false, Single-run setting=true2022.03 | 50.1 | — | 0.606 | 43 | |
| ADAPT2024.04 | 46.9 | 40.2 | 0.541 | 0.377 | |
| HOP+2024.04 | 45.7 | 38.4 | 0.52 | 0.36 | |
| HOP+2026.03 | 45.7 | — | 0.52 | 0.36 | |
| SOAT2024.04 | 44.2 | — | 0.548 | 0.364 | |
| FOAM2024.04 | 42.8 | 38.7 | 0.541 | 0.356 | |
| EnvDrop-CLIPPre-trained=false, Single-run setting=true2022.03 | 42.6 | — | 0.557 | — | |
| HOPIteration=22022.03 | 42.3 | 0.36 | 0.52 | 0.33 | |
| HOP2026.03 | 42.3 | — | 0.52 | 0.33 | |
| HOPIteration=12022.03 | 42.1 | 0.36 | 0.51 | 0.33 | |
| EnvDrop + SyntaxSyntax-aware=true2022.03 | 39.2 | 0.35 | 0.52 | 0.32 | |
| Syntax2024.04 | 39.2 | 35 | 0.52 | 0.32 | |
| EnvDrop2022.03 | 38.5 | 0.34 | 0.51 | 0.32 | |
| BitFitUpdated Params(%)=0.282023.08 | 36.63 | 34.34 | 0.5047 | 0.3049 | |
| HOPIteration=02022.03 | 36.3 | 0.31 | 0.48 | 0.29 | |
| Prompt TuningUpdated Params(%)=0.232023.08 | 29.95 | 27.72 | 0.4494 | 0.2467 | |
| Baseline2022.03 | 26.1 | — | 0.42 | 0.21 |