Remote Grounding on REVERIE unseen (val)
34.51RGSKERM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KERMTraining Strategy=Pre-training and fine-tuning2023.03 | 34.51 | 24.45 | |
| KERM-ptTraining Strategy=Pre-training2023.03 | 33.97 | 24.14 | |
| DUET2023.03 | 32.15 | 23.03 | |
| SIA2021.10 | 22.41 | 11.56 | |
| HAMT2023.03 | 18.92 | 17.28 | |
| HAMT2021.10 | 18.92 | 17.28 | |
| HOP2023.03 | 18.85 | 15.73 | |
| VLNBERT2023.03 | 18.77 | 15.27 | |
| RecBERT2021.10 | 18.77 | 15.27 | |
| Fine-TuningUpdated Params(%)=1002023.08 | 18.66 | 16.06 | |
| VLN-PETLUpdated Params(%)=2.812023.08 | 18.26 | 15.96 | |
| AirBERT2023.03 | 18.23 | 14.18 | |
| AdapterUpdated Params(%)=3.392023.08 | 16.05 | 14.21 | |
| LORAUpdated Params(%)=3.332023.08 | 15.25 | 13.45 | |
| BitFitUpdated Params(%)=0.802023.08 | 10.85 | 9.43 | |
| FAST-MATTN2021.10 | 7.84 | 4.67 | |
| Prompt TuningUpdated Params(%)=0.712023.08 | 5.82 | 5.07 | |
| RCM2023.03 | 4.89 | 3.89 | |
| RCM2021.10 | 4.89 | 3.89 | |
| SMNA2021.10 | 4.54 | 3.61 | |
| Seq2Seq2023.03 | 2.16 | 1.63 | |
| Seq2Seq2021.10 | 2.16 | 1.63 |