Navigation on REVERIE (val seen)
50.53Success Rate (SR)FAST-MATTN
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FAST-MATTN2021.08 | 50.53 | 55.17 | 45.5 | 16.35 | |
| Rec (Airbert)mode=discriminative2021.08 | 47.01 | 48.98 | 42.34 | 15.16 | |
| Fine-TuningUpdated Params(%)=1002023.08 | 46.73 | 52.35 | 42.75 | 13.37 | |
| VLN-PETLUpdated Params(%)=2.812023.08 | 45.96 | 51.23 | 42.6 | 12.86 | |
| Rec (ViLBERT)mode=discriminative2021.08 | 43.64 | 45.61 | 37.86 | 15.75 | |
| LORAUpdated Params(%)=3.332023.08 | 42.3 | 46.24 | 38.63 | 12.89 | |
| SMNA2021.08 | 41.25 | 43.29 | 39.61 | 7.54 | |
| Rec (VLN-BERT)mode=discriminative2021.08 | 41.11 | 42.87 | 35.55 | 15.62 | |
| AdapterUpdated Params(%)=3.392023.08 | 40.76 | 45.05 | 37.43 | 13.75 | |
| Rec (OSCAR)mode=discriminative2021.08 | 39.85 | 41.32 | 35.86 | 12.85 | |
| BitFitUpdated Params(%)=0.802023.08 | 33.52 | 37.81 | 31.84 | 11.45 | |
| Seq2Seq-SF2021.08 | 29.59 | 35.7 | 24.01 | 12.88 | |
| Prompt TuningUpdated Params(%)=0.712023.08 | 25.86 | 33.17 | 23.21 | 12.15 | |
| RCM2021.08 | 23.33 | 29.44 | 21.82 | 10.7 |