Instruction Execution on VirtualHome Unseen domains
83.61Success RateTMoW
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TMoWshot=5-Shot2026.01 | 83.61 | 12.04 | |
| TMoWshot=Average2026.01 | 82.59 | 12.62 | |
| TMoWshot=1-Shot2026.01 | 81.56 | 13.2 | |
| SayCanPayshot=5-Shot2026.01 | 58.88 | 16.92 | |
| SayCanPayshot=Average2026.01 | 56.93 | 17.35 | |
| SayCanPayshot=1-Shot2026.01 | 54.98 | 17.77 | |
| LLM+FTshot=5-Shot2026.01 | 54.36 | 18.55 | |
| LLM+FTshot=Average2026.01 | 52.41 | 19.03 | |
| LLM+FTshot=1-Shot2026.01 | 50.46 | 19.51 | |
| FLAREshot=5-Shot2026.01 | 46.64 | 20.67 | |
| LLM-Plannershot=5-Shot2026.01 | 43.61 | 21.06 | |
| LLM-Plannershot=Average2026.01 | 43.3 | 21.45 | |
| FLAREshot=Average2026.01 | 42.29 | 21.56 | |
| FLAREshot=1-Shot2026.01 | 42.17 | 22.19 | |
| LLM-Plannershot=1-Shot2026.01 | 40.97 | 22.07 |