iTHOR
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
iTHOR v1 (L >= 5)
77.22SR
14
iTHOR v1 (ALL)
82.47Success Rate (SR)
14
iTHOR challenge 2021 (test)
0.965FS (Final Success)
14
iThor
30Success Rate (Kitchen)
8
iTHOR Unseen class (14/8)
87Success Rate
5
iTHOR Seen class (14/8)
84.7Success Rate
5
iTHOR Unseen class (18/4)
95SR
5
iTHOR Seen class (18/4)
88.7Success Rate (SR)
5
iTHOR (FloorPlan229)
93.1Accuracy
4
iTHOR (FloorPlan225)
88.8Accuracy
4
iTHOR FloorPlan220
89.1Accuracy
4
iTHOR (FloorPlan213)
93.9Accuracy
4
iTHOR FloorPlan210
93.3Accuracy
4
iTHOR FloorPlan207
92Accuracy
4
iTHOR
14.19HL Reward
3