Hierarchical Task Analysis on SG3D 8 scenes HM3DSem (test)
38.71Success RecallASHITA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ASHITAground truth object positions=true, knowledge of ground truth labels=true, representation=Text Embeddings2025.04 | 38.71 | 34.39 | 36.1 | |
| Hydra (GT Seg) + GPTLLM=GPT-4o-mini, knowledge of ground truth labels=true, ground truth object positions=false2025.04 | 17.06 | 18.98 | 14.63 | |
| ASHITAground truth object positions=true, knowledge of ground truth labels=false2025.04 | 15.12 | 34.47 | 16.59 | |
| ASHITAknowledge of ground truth labels=false, ground truth object positions=false2025.04 | 10.39 | 20.6 | 9.27 | |
| Hydra + GPTLLM=GPT-4o-mini, knowledge of ground truth labels=false, ground truth object positions=false2025.04 | 9.43 | 15.51 | 4.88 | |
| HOV-SG + GPTLLM=GPT-4o-mini, knowledge of ground truth labels=false, ground truth object positions=false2025.04 | 4.55 | 4.87 | 1.95 |