R2R
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
R2R-TopDown (val unseen)
47Success Rate (SR)
7
R2R (test)
76SR
7
R2R
5.32Navigation Error (NE)
6
R2R-CE
3.86Navigation Error (NE)
6
R2R-CE
401Latency (ms/step)
6
R2R (val-unseen)
24.5WC
6
R2R unseen complementary (val)
7.8Path Length (PL)
6
R2R Continuous Environments (test)
28.53SR (Gaussian)
5
R2R-TopDown (val seen)
65Success Rate (SR)
5
R2R
4.68FPS
5
R2R (val)
5.7Navigation Error (NE)
5
R2R 72 scenes
5.02NE
5
R2R unseen (val)
0.708BLEU-1
5
R2R (val seen)
0.728BLEU-1
5
R2R Warehouse Layout (N=100)
54,331.84Normalized Cost
4
R2R (seen)
3.84Navigation Error (NE)
4
R2R-Goal (val unseen)
69SSIM
3
R2R Unseen (val)
1.5EDR
3
R2R Seen (val)
0.3EDR
3
R2R Back (val-seen)
22.33TL (Path Length)
3
R2R-Last (val unseen)
45.2Success Rate (SR)
3
R2R-Last (val seen)
53.3Success Rate (SR)
3
R2R-CE
32.72SR (Gaussian Noise)
2
R2R VLN (val unseen)
4.05Navigation Error (NE)
2