Vision-Language Navigation on GSA-R2R Basic Instructions Residential v1 (test)
69.8SRMemoir (Ours)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Memoir (Ours)Pre-training=Full navigation graph, Retrieval=Enabled2025.10 | 69.8 | 64.9 | 73.3 | |
| GR-DUETPre-training=Full navigation graph2025.10 | 69.3 | 64.3 | 71.4 | |
| GR-DUET*Pre-training=Full navigation graph, Experimental conditions=Aligned2025.10 | 67.6 | 63.6 | 71.9 | |
| Memoir (w/o retrieval)Pre-training=Full navigation graph, Retrieval=Disabled2025.10 | 63 | 52.9 | 61 | |
| DUET + BT2025.10 | 61.3 | 57.7 | 70.1 | |
| DUET + MLM2025.10 | 57.9 | 47.3 | 55.9 | |
| DUET2025.10 | 57.7 | 47 | 55.6 | |
| DUET + MRC2025.10 | 57.7 | 47 | 55.6 | |
| DUET + SAR2025.10 | 57.6 | 44.6 | 53 | |
| DUET + TENT2025.10 | 57.2 | 44.2 | 52.9 | |
| OVER-NAV2025.10 | 22.3 | 16.8 | 37.1 | |
| TourHAMT2025.10 | 14.9 | 12.2 | 34.7 |