SOON
Benchmarks
TaskDatasetSOTA resultTrendResults
SOON (val unseen)
38.4SPL
37
SOON Unseen (test)
59.2SR
18
SOON unseen house (test)
90.4Success Rate
10
SOON seen house (val)
7,630SR
9
SOON seen instruction (val)
100SR
8
SOON (test-unseen)
48.7OSR
7
SOON (test)
29.4SPL
7
SOON U (val)
32.7SPL
5
SOON (test unseen)
25.4SPL
5