Outdoor Vision-and-Language Navigation on Touchdown (test)
16.2Task Completion Rate (TC)VLN Transformer
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| VLN TransformerPre-training configuration=Manh-50 + MTST style2020.07 | 16.2 | 20.8 | 15.7 | 50.5 | 27.8 | 15 | |
| VLN TransformerPre-training configuration=Manh-502020.07 | 15.5 | 21.9 | 15.4 | 45.9 | 26.1 | 14.2 | |
| VLN TransformerPre-training configuration=None2020.07 | 14.9 | 21.2 | 14.6 | 45.4 | 25.3 | 14 | |
| GAPre-training configuration=Manh-50 + MTST style2020.07 | 13.9 | 18.4 | 13.5 | 53.5 | 27.5 | 12.9 | |
| GAPre-training configuration=Manh-502020.07 | 13.1 | 18.4 | 12.8 | 54.2 | 26.8 | 12.1 | |
| RCONCATPre-training configuration=Manh-50 + MTST style2020.07 | 12.6 | 20.4 | 12.3 | 48 | 23.9 | 11.8 | |
| RCONCATPre-training configuration=Manh-502020.07 | 12.1 | 19.4 | 11.8 | 49.4 | 24 | 11.3 | |
| GAPre-training configuration=None2020.07 | 11.9 | 19 | 11.5 | 51.6 | 24.9 | 10.9 | |
| RCONCATPre-training configuration=None2020.07 | 11.8 | 20.4 | 11.5 | 47.9 | 22.9 | 11.1 |