Vision-Language Navigation on GSA-R2R User Instructions Residential v1 (test)
66.1SRMemoir (Ours)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Memoir (Ours)Pre-training=Full navigation graph, Retrieval=Enabled2025.10 | 66.1 | 61.3 | |
| GR-DUETPre-training=Full navigation graph2025.10 | 64.8 | 59.6 | |
| GR-DUET*Pre-training=Full navigation graph, Experimental conditions=Aligned2025.10 | 63.8 | 59.8 | |
| Memoir (w/o retrieval)Pre-training=Full navigation graph, Retrieval=Disabled2025.10 | 59.6 | 50.1 | |
| DUET + BT2025.10 | 59 | 55.7 | |
| DUET + MLM2025.10 | 55.2 | 45.2 | |
| DUET2025.10 | 54.6 | 44.9 | |
| DUET + MRC2025.10 | 54.5 | 44.8 | |
| DUET + TENT2025.10 | 53.8 | 42.3 | |
| DUET + SAR2025.10 | 53.7 | 41.9 | |
| OVER-NAV2025.10 | 20.4 | 16.1 | |
| TourHAMT2025.10 | 14.7 | 12 |