REVERIE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
REVERIE (val unseen)
53.2SPL
237
REVERIE unseen (test)
81.5Success Rate (SR)
110
REVERIE seen (val)
84.33SR
64
REVERIE Unseen (test)
81.51SR
51
REVERIE (val unseen)
62.4Success Rate (SR)
42
REVERIE (test unseen)
62.22OSR
38
REVERIE (val unseen)
61.09OSR
38
REVERIE (val seen)
71.05RGSPL
37
REVERIE unseen (test)
77.84RGS
33
REVERIE (test)
3,606SPL
30
REVERIE-AIM (val-unseen)
50.4ONS@0.1m
25
REVERIE unseen (val)
34.51RGS
22
REVERIE unseen 1.0 (val)
22.41RGS
15
REVERIE 1.0 (val seen)
61.91Succ.
15
REVERIE (val seen)
50.53Success Rate (SR)
14
REVERIE CE (val unseen)
4.9NE
13
REVERIE Unseen Discrete (val)
63.9OSR
10
REVERIE
76.92Success Rate (SR)
9
REVERIE (test unseen)
16.83RGS
8
REVERIE (val unseen)
18.23RGS
8
REVERIE (val seen)
32.75RGS
8
REVERIE 1.0 (test unseen)
81.51Succ.
6
REVERIE-CE (val seen)
5.38NE
5