ProcTHOR
Benchmarks
TaskDatasetSOTA resultTrendResults
AVS-ProcTHOR (val)
93.02Existence Score
11
ProcTHOR (Habit #3)
50.98Success Rate @ 1m
9
ProcTHOR Habit #2
50.49SR@1
9
ProcTHOR (Habit #1)
57.7Success Rate @1 (SR@1)
9
ProcTHOR 150 distinct maps (test)
215.59Average Navigation Cost
9
ProcTHOR Large
429.83Average Cost
9
ProcTHOR Medium
269.45Average Cost
9
ProcTHOR Small
130.86Average Cost
9
ProcTHOR single-object (OOD Systematic)
75Accuracy
9
ProcTHOR single-object (OOD Compositional)
95Accuracy
9
ProcTHOR single-object (IID)
97Accuracy
9
ProcTHOR multi-object
94IID Accuracy
8
Procthor-10K (Easy)
75.6Score (SceneCritic) Method A
6
Procthor-10K Complex 1.0 (test)
79.5Method A SceneCritic Score
6
ProcTHOR-10k 7-10 rooms (test)
100SR
6
ProcTHOR-10k 4-6 rooms (test)
100Success Rate
6
ProcTHOR-10k 1-3 rooms (test)
100Success Rate (SR)
6
ProcTHOR Semi-static simulator
0.024MAE
5
PROCTHOR Any-of-Three
22.03Average Cost
5
PROCTHOR Breakfast+Coffee
207.17Average Cost
5
PROCTHOR Coffee
112.76Avg Cost
5
PROCTHOR Breakfast
82.59Average Cost
5
PROCTHOR Deliver 3-Object
94.58Avg. Cost
5
ProcTHOR
58Success Rate
4