Remote Grounding on REVERIE unseen (test)
77.84RGSHuman
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Human2022.03 | 77.84 | 51.44 | |
| KERM-ptTraining Strategy=Pre-training2023.03 | 32.69 | 23.15 | |
| KERMTraining Strategy=Pre-training and fine-tuning2023.03 | 32.39 | 23.64 | |
| DUET2023.03 | 31.88 | 22.06 | |
| SIA2021.10 | 19.02 | 9.2 | |
| HOPversion=22022.03 | 17.69 | 14.34 | |
| HOP2023.03 | 17.69 | 14.34 | |
| HOPversion=12022.03 | 17.13 | 13.9 | |
| AirBERT2022.03 | 16.83 | 13.28 | |
| AirBERT2023.03 | 16.83 | 13.28 | |
| RecBERT2022.03 | 16.5 | 13.51 | |
| VLNBERT2023.03 | 16.5 | 13.51 | |
| RecBERT2021.10 | 16.5 | 13.51 | |
| VLN-PETLUpdated Params(%)=2.812023.08 | 15.13 | 13.03 | |
| Fine-TuningUpdated Params(%)=1002023.08 | 15.04 | 13.32 | |
| LORAUpdated Params(%)=3.332023.08 | 14.94 | 12.76 | |
| HAMT2023.03 | 14.88 | 13.08 | |
| HAMT2021.10 | 14.88 | 13.08 | |
| AdapterUpdated Params(%)=3.392023.08 | 14.51 | 12.48 | |
| FAST-MATTN2022.03 | 11.28 | 6.08 | |
| FAST-MATTN2021.10 | 11.28 | 6.08 | |
| HOPversion=02022.03 | 11.17 | 9.1 | |
| ORIST2022.03 | 10.68 | 9.28 | |
| BitFitUpdated Params(%)=0.802023.08 | 9.87 | 8.62 | |
| FAST-Short2022.03 | 7.07 | 4.52 | |
| Prompt TuningUpdated Params(%)=0.712023.08 | 5.51 | 4.88 | |
| RCM2022.03 | 3.67 | 3.14 | |
| RCM2023.03 | 3.67 | 3.14 | |
| RCM2021.10 | 3.67 | 3.14 | |
| SMNA2022.03 | 3.1 | 2.39 | |
| SMNA2021.10 | 3.1 | 2.39 | |
| Seq2Seq2023.03 | 2 | 1.58 | |
| Seq2Seq2021.10 | 2 | 1.58 |