Vision-and-Language Navigation on VLN-CE 1.0 (val-seen)
4.81Navigation Error (NE)CM²-GT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CM²-GTGround truth local maps=true2022.03 | 4.81 | 12.6 | 58.3 | 52.8 | 41.8 | |
| HPN-CPanoramic images=true, Expressive action space=true2022.03 | 5.17 | 8.71 | 53 | 47 | 45 | |
| CWP-CMAPanoramic images=true2022.10 | 5.2 | 11.47 | 61 | 51 | 45 | |
| HPN+DNPanoramic images=true2022.10 | 5.48 | 8.54 | 53 | 46 | 43 | |
| WS-MGMapPanoramic images=false2022.10 | 5.65 | 10.12 | 51.7 | 46.9 | 43.4 | |
| WPN-CCPanoramic images=true, Expressive action space=true2022.03 | 6.05 | 10.29 | 51 | 40 | 35 | |
| CM²2022.03 | 6.1 | 12.05 | 50.7 | 42.9 | 34.8 | |
| CM2Panoramic images=false2022.10 | 6.1 | 12.05 | 50.7 | 42.9 | 34.8 | |
| LAW2022.03 | 6.35 | 9.34 | 49 | 40 | 37 | |
| LAWPanoramic images=false2022.10 | 6.35 | 9.34 | 49 | 40 | 37 | |
| WPN-DDPanoramic images=true2022.03 | 6.57 | 9.11 | 44 | 35 | 32 | |
| AG-CMTPPanoramic images=true, Pre-experiment exploration=true2022.03 | 6.6 | — | 56.2 | 35.9 | 30.5 | |
| AG-CMTPPanoramic images=true2022.10 | 6.6 | — | 56.2 | 35.9 | 30.5 | |
| Seq2Seq+PM+DA+Aug2022.03 | 7.02 | 9.37 | 46 | 33 | 31 | |
| Seq2SeqPanoramic images=false2022.10 | 7.02 | 9.37 | 46 | 33 | 31 | |
| R2R-CMTPPanoramic images=true, Pre-experiment exploration=true2022.03 | 7.1 | — | 45.4 | 36.1 | 31.2 | |
| R2R-CMTPPanoramic images=true2022.10 | 7.1 | — | 45.4 | 36.1 | 31.2 | |
| CMA+PM+DA+Aug2022.03 | 7.12 | 9.26 | 46 | 37 | 35 | |
| CMAPanoramic images=false2022.10 | 7.12 | 9.26 | 46 | 37 | 35 | |
| SASRAPanoramic images=false2022.10 | 7.17 | 8.89 | — | 36 | 34 |