# Vision-and-Language Navigation on RxR (Room-Across-Room) unseen (val)

Source: [Vision-and-Language Navigation on RxR (Room-Across-Room) unseen (val)](<https://www.sota2.com/research/sota/vision-and-language-navigation-on-rxr-room-across-room-unseen-val>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-03-19T09:21:14.793Z

Evaluation of Vision-and-Language Navigation performance on the RxR (Room-Across-Room) dataset using the 'unseen (val)' split, measured by SR, SPL, nDTW, and sDTW.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Vision-and-Language Navigation |
| Dataset (including any stated split) | RxR (Room-Across-Room) unseen (val) |
| Metric | SR (Success Rate) |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 32 of 32 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [SR (Success Rate)](<https://www.sota2.com/research/sota/vision-and-language-navigation-on-rxr-room-across-room-unseen-val.md?metric=SR%20(Success%20Rate)>): Higher is better; unit: PERCENT.

- [SPL (Path Length Score)](<https://www.sota2.com/research/sota/vision-and-language-navigation-on-rxr-room-across-room-unseen-val.md?metric=SPL%20(Path%20Length%20Score)>): Higher is better; unit: PERCENT.

- [nDTW (Normalized DTW)](<https://www.sota2.com/research/sota/vision-and-language-navigation-on-rxr-room-across-room-unseen-val.md?metric=nDTW%20(Normalized%20DTW)>): Higher is better; unit: SCALAR.

- [sDTW (Soft DTW)](<https://www.sota2.com/research/sota/vision-and-language-navigation-on-rxr-room-across-room-unseen-val.md?metric=sDTW%20(Soft%20DTW)>): Higher is better; unit: SCALAR.

## Recorded results

| Method | SR (Success Rate) | Result date | Report paper |
| --- | --- | --- | --- |
| P3Nav | 69.2 | Not recorded | 69bb83210636e5bf4afc1b48 |
| BEVBert | 68.5 | Not recorded | 69bb83210636e5bf4afc1b48 |
| GOAT | 68.2 | Not recorded | 68fa72f21e209131cea59795 |
| EnvEdit (on HAMT) | 62.8 | Not recorded | 68fa6c171e209131cea32165 |
| EnvEdit | 62.8 | Not recorded | 69bb83210636e5bf4afc1b48 |
| VLN-SIG | 60 | Not recorded | 68fa6f031e209131cea433a0 |
| VLN-PETL | 57.95 | Not recorded | 68fa70661e209131cea4ae7c |
| VLN-PETL | 57.9 | Not recorded | 68fa72f21e209131cea59795 |
| Fine-Tuning | 57.88 | Not recorded | 68fa70661e209131cea4ae7c |
| HAMT | 56.5 | Not recorded | 68fa6c171e209131cea32165 |
| HAMT | 56.5 | Not recorded | 68fa6f031e209131cea433a0 |
| HAMT | 56.5 | Not recorded | 69bb83210636e5bf4afc1b48 |
| Adapter | 55.19 | Not recorded | 68fa70661e209131cea4ae7c |
| LoRA | 54.53 | Not recorded | 68fa70661e209131cea4ae7c |
| MARM-MP | 50.2 | Not recorded | 68fa72f21e209131cea59795 |
| EnvEdit (on EnvDrop-CLIP) | 50.1 | Not recorded | 68fa6c171e209131cea32165 |
| ADAPT | 46.9 | Not recorded | 68fa72f21e209131cea59795 |
| HOP+ | 45.7 | Not recorded | 68fa72f21e209131cea59795 |
| HOP+ | 45.7 | Not recorded | 69bb83210636e5bf4afc1b48 |
| SOAT | 44.2 | Not recorded | 68fa72f21e209131cea59795 |
| FOAM | 42.8 | Not recorded | 68fa72f21e209131cea59795 |
| EnvDrop-CLIP | 42.6 | Not recorded | 68fa6c171e209131cea32165 |
| HOP | 42.3 | Not recorded | 68fa6c0d1e209131cea31b5d |
| HOP | 42.3 | Not recorded | 69bb83210636e5bf4afc1b48 |
| HOP | 42.1 | Not recorded | 68fa6c0d1e209131cea31b5d |
| EnvDrop + Syntax | 39.2 | Not recorded | 68fa6c0d1e209131cea31b5d |
| Syntax | 39.2 | Not recorded | 68fa72f21e209131cea59795 |
| EnvDrop | 38.5 | Not recorded | 68fa6c0d1e209131cea31b5d |
| BitFit | 36.63 | Not recorded | 68fa70661e209131cea4ae7c |
| HOP | 36.3 | Not recorded | 68fa6c0d1e209131cea31b5d |
| Prompt Tuning | 29.95 | Not recorded | 68fa70661e209131cea4ae7c |
| Baseline | 26.1 | Not recorded | 68fa6c0d1e209131cea31b5d |

### P3Nav

SR (Success Rate): 69.2. Result ID: 69bbc00547f34ce924a5e7dd.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BEVBert

SR (Success Rate): 68.5. Result ID: 69bbc00547f34ce924a5e7dc.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703e1e209131cea49eaf.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### GOAT

SR (Success Rate): 68.2. Result ID: 699289fa3a6c3148490fa4cd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Implementation](<https://github.com/CrystalSixone/VLN-GOAT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EnvEdit (on HAMT)

SR (Success Rate): 62.8. Result ID: 698eceaaffc3901de0a175e1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Implementation](<https://github.com/jialuli-luka/EnvEdit>)

Recorded evaluation configuration: {"Pre-trained":true,"Single-run setting":true}. This record does not assert independent reproduction.

### EnvEdit

SR (Success Rate): 62.8. Result ID: 69bbc00547f34ce924a5e7db.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Implementation](<https://github.com/jialuli-luka/EnvEdit>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### VLN-SIG

SR (Success Rate): 60. Result ID: 69908daf3a6c314849016652.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f031e209131cea433a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f031e209131cea433a0.md>)

[Implementation](<https://jialuli-luka.github.io/VLN-SIG>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### VLN-PETL

SR (Success Rate): 57.95. Result ID: 69911c4c3a6c31484905c34a.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Implementation](<https://github.com/YanyuanQiao/VLN-PETL>)

Recorded evaluation configuration: {"Updated Params(%)":"1.67"}. This record does not assert independent reproduction.

### VLN-PETL

SR (Success Rate): 57.9. Result ID: 699289fa3a6c3148490fa4cc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Implementation](<https://github.com/YanyuanQiao/VLN-PETL>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Fine-Tuning

SR (Success Rate): 57.88. Result ID: 69911c4c3a6c31484905c345.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

Recorded evaluation configuration: {"Updated Params(%)":"100"}. This record does not assert independent reproduction.

### HAMT

SR (Success Rate): 56.5. Result ID: 698eceaaffc3901de0a175df.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70531e209131cea4a418.md>)

[Implementation](<https://cshizhe.github.io/projects/vln_hamt.html>)

Recorded evaluation configuration: {"Pre-trained":true,"Single-run setting":true}. This record does not assert independent reproduction.

### HAMT

SR (Success Rate): 56.5. Result ID: 69908daf3a6c314849016651.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6f031e209131cea433a0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70531e209131cea4a418.md>)

[Implementation](<https://cshizhe.github.io/projects/vln_hamt.html>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HAMT

SR (Success Rate): 56.5. Result ID: 69bbc00547f34ce924a5e7d8.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70531e209131cea4a418.md>)

[Implementation](<https://cshizhe.github.io/projects/vln_hamt.html>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### Adapter

SR (Success Rate): 55.19. Result ID: 69911c4c3a6c31484905c349.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65e31e209131cea0d324.md>)

[Implementation](<https://github.com/google-research/adapter-bert>)

Recorded evaluation configuration: {"Updated Params(%)":"1.90"}. This record does not assert independent reproduction.

### LoRA

SR (Success Rate): 54.53. Result ID: 69911c4c3a6c31484905c348.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b121e209131cea2bf59.md>)

[Implementation](<https://github.com/microsoft/LoRA>)

Recorded evaluation configuration: {"Updated Params(%)":"1.86"}. This record does not assert independent reproduction.

### MARM-MP

SR (Success Rate): 50.2. Result ID: 699289fa3a6c3148490fa4cb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f131e209131cea43bb8.md>)

[Implementation](<https://github.com/google-research-datasets/RxR/tree/main/marky-mT5>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EnvEdit (on EnvDrop-CLIP)

SR (Success Rate): 50.1. Result ID: 698eceaaffc3901de0a175e0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Implementation](<https://github.com/jialuli-luka/EnvEdit>)

Recorded evaluation configuration: {"Pre-trained":false,"Single-run setting":true}. This record does not assert independent reproduction.

### ADAPT

SR (Success Rate): 46.9. Result ID: 699289fa3a6c3148490fa4ca.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6ca21e209131cea35170.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HOP+

SR (Success Rate): 45.7. Result ID: 699289fa3a6c3148490fa4c8.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HOP+

SR (Success Rate): 45.7. Result ID: 69bbc00547f34ce924a5e7da.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### SOAT

SR (Success Rate): 44.2. Result ID: 699289fa3a6c3148490fa4c7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6b171e209131cea2c159.md>)

[Implementation](<https://github.com/YicongHong/Recurrent-VLN-BERT>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### FOAM

SR (Success Rate): 42.8. Result ID: 699289fa3a6c3148490fa4c9.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6cb61e209131cea357b5.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EnvDrop-CLIP

SR (Success Rate): 42.6. Result ID: 698eceaaffc3901de0a175de.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c171e209131cea32165.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a621e209131cea27e49.md>)

[Implementation](<https://github.com/clip-vil/CLIP-ViL>)

Recorded evaluation configuration: {"Pre-trained":false,"Single-run setting":true}. This record does not assert independent reproduction.

### HOP

SR (Success Rate): 42.3. Result ID: 698ebddfffc3901de0a04612.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Implementation](<https://github.com/YanyuanQiao/HOP-VLN>)

Recorded evaluation configuration: {"Iteration":"2"}. This record does not assert independent reproduction.

### HOP

SR (Success Rate): 42.3. Result ID: 69bbc00547f34ce924a5e7d9.

[Reporting paper](<https://www.sota2.com/research/paper/69bb83210636e5bf4afc1b48.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Implementation](<https://github.com/YanyuanQiao/HOP-VLN>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### HOP

SR (Success Rate): 42.1. Result ID: 698ebddfffc3901de0a04611.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Implementation](<https://github.com/YanyuanQiao/HOP-VLN>)

Recorded evaluation configuration: {"Iteration":"1"}. This record does not assert independent reproduction.

### EnvDrop + Syntax

SR (Success Rate): 39.2. Result ID: 698ebddfffc3901de0a0460f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69c81e209131cea23ef6.md>)

Recorded evaluation configuration: {"Syntax-aware":true}. This record does not assert independent reproduction.

### Syntax

SR (Success Rate): 39.2. Result ID: 699289fa3a6c3148490fa4c6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa72f21e209131cea59795.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa69c81e209131cea23ef6.md>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### EnvDrop

SR (Success Rate): 38.5. Result ID: 698ebddfffc3901de0a0460e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65a21e209131cea0b711.md>)

[Implementation](<https://github.com/airsplay/R2R-EnvDrop>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

### BitFit

SR (Success Rate): 36.63. Result ID: 69911c4c3a6c31484905c346.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6d5a1e209131cea39632.md>)

[Implementation](<https://www.github.com/benzakenelad/BitFit>)

Recorded evaluation configuration: {"Updated Params(%)":"0.28"}. This record does not assert independent reproduction.

### HOP

SR (Success Rate): 36.3. Result ID: 698ebddfffc3901de0a04610.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Implementation](<https://github.com/YanyuanQiao/HOP-VLN>)

Recorded evaluation configuration: {"Iteration":"0"}. This record does not assert independent reproduction.

### Prompt Tuning

SR (Success Rate): 29.95. Result ID: 69911c4c3a6c31484905c347.

[Reporting paper](<https://www.sota2.com/research/paper/68fa70661e209131cea4ae7c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6aa51e209131cea296c9.md>)

Recorded evaluation configuration: {"Updated Params(%)":"0.23"}. This record does not assert independent reproduction.

### Baseline

SR (Success Rate): 26.1. Result ID: 698ebddfffc3901de0a0460d.

[Reporting paper](<https://www.sota2.com/research/paper/68fa6c0d1e209131cea31b5d.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa68881e209131cea1cbac.md>)

[Implementation](<https://github.com/google-research-datasets/RxR>)

Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.