R4R
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
R4R unseen (val)
47Success Rate (SR)
60
R4R (val seen)
66.8SR
22
R4R in-domain (unseen portion)
36.2SR
8
R4R unseen v1.0 (val)
11.6Path Length
6
R4R unseen complementary (val)
32.5PL (Path Length)
6