Vision-and-Language Navigation on VLN-CE 1.0 (val-unseen)
6.02Navigation Error (NE)HPN-C
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HPN-CPanoramic images=true, Expressive action space=true2022.03 | 6.02 | 7.71 | 42 | 38 | 36 | |
| CWP-CMAPanoramic images=true2022.10 | 6.2 | 10.9 | 52 | 41 | 36 | |
| CM²-GTGround truth local maps=true2022.03 | 6.23 | 10.68 | 41.3 | 37 | 30.6 | |
| WS-MGMapPanoramic images=false2022.10 | 6.28 | 10 | 47.6 | 38.9 | 34.3 | |
| HPN+DNPanoramic images=true2022.10 | 6.31 | 7.62 | 40 | 36 | 34 | |
| WPN-CCPanoramic images=true, Expressive action space=true2022.03 | 6.62 | 10.62 | 43 | 36 | 30 | |
| LAW2022.03 | 6.83 | 8.89 | 44 | 35 | 31 | |
| LAWPanoramic images=false2022.10 | 6.83 | 8.89 | 44 | 35 | 31 | |
| CM²2022.03 | 7.02 | 11.54 | 41.5 | 34.3 | 27.6 | |
| CM2Panoramic images=false2022.10 | 7.02 | 11.54 | 41.5 | 34.3 | 27.6 | |
| CMA+PM+DA+Aug2022.03 | 7.37 | 8.64 | 40 | 32 | 30 | |
| CMAPanoramic images=false2022.10 | 7.37 | 8.64 | 40 | 32 | 30 | |
| WPN-DDPanoramic images=true2022.03 | 7.48 | 8.23 | 35 | 28 | 26 | |
| Seq2Seq+PM+DA+Aug2022.03 | 7.77 | 9.32 | 37 | 25 | 22 | |
| Seq2SeqPanoramic images=false2022.10 | 7.77 | 9.32 | 37 | 25 | 22 | |
| AG-CMTPPanoramic images=true, Pre-experiment exploration=true2022.03 | 7.9 | — | 39.2 | 23.1 | 19.1 | |
| R2R-CMTPPanoramic images=true, Pre-experiment exploration=true2022.03 | 7.9 | — | 38 | 26.4 | 22.7 | |
| AG-CMTPPanoramic images=true2022.10 | 7.9 | — | 39.2 | 23.1 | 19.1 | |
| R2R-CMTPPanoramic images=true2022.10 | 7.9 | — | 38 | 26.4 | 22.7 | |
| SASRAPanoramic images=false2022.10 | 8.32 | 7.89 | — | 24 | 22 |