Vision-and-Language Navigation on RxR seen (val)
75.9SRMARVAL
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MARVALTraining protocol=DAGGER2022.10 | 75.9 | 3.01 | 79.1 | 68.8 | — | |
| MARVALTraining protocol=Finetuned-BC2022.10 | 75.4 | 3.25 | 79 | 68.7 | — | |
| GOAT2024.04 | 74.1 | — | 71 | 61.4 | 68.1 | |
| MARVALTraining protocol=Pre-Explore, Privileged access=Yes2022.10 | 73.7 | 3.33 | 77.6 | 66.6 | — | |
| MARVALTraining protocol=Pretrained2022.10 | 72.7 | 3.62 | 77 | 65.9 | — | |
| EnvEditEnsemble=3 agents2022.10 | 67.2 | — | 71.1 | 58.5 | — | |
| Fine-TuningUpdated Params(%)=1002023.08 | 64.93 | — | 69.26 | 55.92 | 61.28 | |
| HNR2024.04 | 63.72 | 4.85 | 68.81 | 52.78 | 53.17 | |
| ETPNav2024.04 | 61.46 | 5.03 | 66.41 | 51.28 | 50.83 | |
| VLN-PETL2024.04 | 60.5 | — | 65.7 | 51.7 | 56.8 | |
| VLN-PETLUpdated Params(%)=1.672023.08 | 60.48 | — | 65.74 | 51.67 | 56.77 | |
| HAMT2022.10 | 59.4 | — | 65.3 | 50.9 | — | |
| AdapterUpdated Params(%)=1.902023.08 | 58.52 | — | 65.14 | 50.23 | 54.96 | |
| LoRAUpdated Params(%)=1.862023.08 | 55.66 | — | 63.2 | 47.31 | 52.41 | |
| HOP+2024.04 | 53.6 | — | 59 | 43 | 47.9 | |
| Reborn2024.04 | 52.43 | 5.69 | 66.27 | 44.47 | 45.46 | |
| ADAPT2024.04 | 50.3 | — | 56.3 | 40.6 | 44.6 | |
| Syntax2024.04 | 48.1 | — | 58 | 40 | 44 | |
| BitFitUpdated Params(%)=0.282023.08 | 35.69 | — | 49.37 | 29.81 | 33.58 | |
| Prompt TuningUpdated Params(%)=0.232023.08 | 27.92 | — | 42.93 | 22.97 | 25.98 | |
| LSTM2022.10 | 25.2 | 10.7 | 42.2 | 20.7 | — |