Task 1
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Task 1 pooled across three runs 1.0 (test)
24Ours Win Count
5
Task 1 1.0 (train)
79Prob. of Improvement
5
Task 1
1.239TTFT (s)
4
Task 1 Boundary Conditions
21.15Min Compliance
3
Task 1 Scenario: Bring warm water and an apple
80Average Success Rate (Task 1)
3
Task 1 Real robot evaluation (holdout set)
0.317Optimality Gap
3