Mobile Manipulation on ALFRED seen (test)
65.09Success Rate (SR)ESCAPE
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| ESCAPEStep-by-step instructions=true2026.04 | 65.09 | 72.88 | 52.42 | 58.29 | |
| ThinkBotStep-by-step instructions=true2026.04 | 62.69 | 71.64 | 32.02 | 37.01 | |
| ESCAPEStep-by-step instructions=false2026.04 | 61.24 | 68.74 | 46.89 | 53.22 | |
| DISCOStep-by-step instructions=true2026.04 | 59.5 | 66.1 | 40.6 | 47.4 | |
| DISCOStep-by-step instructions=false2026.04 | 58 | 64.9 | 39.6 | 46.5 | |
| CAPEAMStep-by-step instructions=true2026.04 | 51.79 | 60.5 | 21.6 | 25.88 | |
| PrompterStep-by-step instructions=true2026.04 | 51.17 | 60.22 | 25.12 | 30.21 | |
| PrompterStep-by-step instructions=false2026.04 | 47.95 | 56.98 | 23.29 | 28.42 | |
| CAPEAMStep-by-step instructions=false2026.04 | 47.36 | 54.38 | 19.03 | 23.78 | |
| ABPStep-by-step instructions=true2026.04 | 44.55 | 51.13 | 3.88 | 4.92 | |
| LGS-RPAStep-by-step instructions=true2026.04 | 40.05 | 48.66 | 21.28 | 28.97 | |
| E.T.Step-by-step instructions=true2026.04 | 38.42 | 45.44 | 27.78 | 34.93 | |
| LGS-RPAStep-by-step instructions=false2026.04 | 33.01 | 41.71 | 16.65 | 24.49 | |
| FILMStep-by-step instructions=true2026.04 | 27.67 | 38.51 | 11.23 | 15.06 | |
| MOCAStep-by-step instructions=true2026.04 | 26.81 | 33.2 | 19.52 | 26.33 | |
| FILMStep-by-step instructions=false2026.04 | 25.77 | 36.15 | 10.39 | 14.17 | |
| HLSMStep-by-step instructions=false2026.04 | 25.11 | 35.79 | 6.69 | 11.53 | |
| Seq2SeqStep-by-step instructions=true2026.04 | 4 | 9.4 | 2 | 6.3 |