Navigation on REVERIE (val unseen)
62.4Success Rate (SR)TANDEM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| TANDEM2026.06 | 62.4 | — | 45.6 | — | |
| Previous SOTA2024.09 | 61 | — | — | — | |
| ScaleVLN2026.06 | 57 | — | 41.8 | — | |
| AutoVLN2026.06 | 55.9 | — | 40.9 | — | |
| GOAT2026.06 | 53.4 | — | 36.7 | — | |
| DUET2026.06 | 47 | — | 33.7 | — | |
| SAME2026.06 | 46.4 | — | 36.1 | — | |
| NaviLLM2026.06 | 42.2 | — | 35.7 | — | |
| HAMT2026.06 | 33 | — | 30.2 | — | |
| HAMT2021.10 | 32.95 | 36.84 | 30.2 | 14.08 | |
| Fine-TuningUpdated Params(%)=1002023.08 | 32.63 | 37.82 | 28.92 | 15.66 | |
| VLN-PETLUpdated Params(%)=2.812023.08 | 31.81 | 37.03 | 27.67 | 14.47 | |
| HOPversion=22022.03 | 31.78 | 36.24 | 26.11 | 16.46 | |
| GPT-4o2024.09 | 31.6 | — | — | — | |
| SIA2021.10 | 31.53 | 44.67 | 16.28 | 41.53 | |
| Qwen2-VL-72BModel Parameters=72B2024.09 | 31 | — | — | — | |
| RecBERT2022.03 | 30.67 | 35.02 | 24.9 | 16.78 | |
| RecBERT2021.10 | 30.67 | 35.02 | 24.9 | 16.78 | |
| HOPversion=12022.03 | 30.39 | 35.3 | 25.1 | 17.16 | |
| AdapterUpdated Params(%)=3.392023.08 | 29.48 | 32.83 | 26.62 | 14.59 | |
| LORAUpdated Params(%)=3.332023.08 | 29.42 | 34.28 | 26.17 | 15.96 | |
| AirBERT2022.03 | 27.89 | 34.51 | 21.88 | 18.71 | |
| Rec (Airbert)mode=discriminative2021.08 | 27.89 | 34.51 | 21.88 | 18.71 | |
| Rec (OSCAR)mode=discriminative2021.08 | 25.53 | 27.66 | 21.06 | 14.35 | |
| Rec (VLN-BERT)mode=discriminative2021.08 | 25.53 | 29.42 | 20.51 | 16.94 | |
| BitFitUpdated Params(%)=0.802023.08 | 24.65 | 27.46 | 21.34 | 12.36 | |
| Rec (ViLBERT)mode=discriminative2021.08 | 24.57 | 29.91 | 19.81 | 17.83 | |
| HOPversion=02022.03 | 24.17 | 30.16 | 20.07 | 16.52 | |
| Prompt TuningUpdated Params(%)=0.712023.08 | 19.94 | 25.08 | 17.75 | 12.43 | |
| ORIST2022.03 | 16.84 | 25.02 | 15.14 | 10.9 | |
| FAST-MATTN2022.03 | 14.4 | 28.2 | 7.19 | 45.28 | |
| FAST-MATTN2021.10 | 14.4 | 28.2 | 7.19 | 45.28 | |
| FAST-MATTN2021.08 | 14.4 | 28.2 | 7.19 | 45.28 | |
| FAST-Short2022.03 | 10.08 | 20.48 | 6.17 | 29.7 | |
| RCM2022.03 | 9.29 | 14.23 | 6.97 | 11.98 | |
| RCM2021.10 | 9.29 | 14.23 | 6.97 | 11.98 | |
| RCM2021.08 | 9.29 | 14.23 | 6.97 | 11.98 | |
| SMNA2022.03 | 8.15 | 11.28 | 6.44 | 9.07 | |
| SMNA2021.10 | 8.15 | 11.28 | 6.44 | 9.07 | |
| SMNA2021.08 | 8.15 | 11.28 | 6.44 | 9.07 | |
| Seq2Seq2021.10 | 4.2 | 8.07 | 2.84 | 11.07 | |
| Seq2Seq-SF2021.08 | 4.2 | 8.07 | 2.84 | 11.07 |