Vision-and-Language Navigation on SOON unseen house (test)
90.4Success RateHuman
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Human2023.03 | 90.4 | 59.2 | 91.4 | 51.1 | |
| Meta-ExploreMemory=Top. Map, Exploit=local goal2023.03 | 39.1 | 25.8 | 48.7 | 4 | |
| DUETMemory=Top. Map, Exploit=X2023.03 | 33.4 | 21.4 | 43 | 4.2 | |
| GBE†Memory=Top. Map, Exploit=X2023.03 | 12.9 | 9.2 | 21.5 | 0.5 | |
| GBEMemory=Top. Map, Exploit=X2023.03 | 11.9 | 10.2 | 19.5 | 1.4 | |
| GBE w/o GEMemory=Top. Map, Exploit=X2023.03 | 11.4 | 8.7 | 18.8 | 0.8 | |
| AuxRNMemory=Rec, Exploit=X2023.03 | 8.1 | 6.7 | 11 | 0.5 | |
| RCMMemory=Rec, Exploit=X2023.03 | 7.4 | 6.2 | 12.4 | 0.7 | |
| Speaker-FollowerMemory=Rec, Exploit=X2023.03 | 7 | 6.1 | 9.8 | 0.6 | |
| RandomMemory=Rec, Exploit=X2023.03 | 2.1 | 0.4 | 2.7 | 0 |