Robot Task Planning on REI-Bench Mixed REs
28.5Object Omission RateLLaMA3.1-8B + TOCC
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LLaMA3.1-8B + TOCCBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 28.5 | 37.9 | 66.4 | |
| LLaMA3.1-8B + APBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 31.3 | 39.7 | 71 | |
| LLaMA3.1-8B + ICLBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 32.7 | 39 | 71.7 | |
| LLaMA3.1-8B + CoTBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 34.9 | 34.2 | 69.1 | |
| LLaMA3.1-8BBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 38.8 | 31.1 | 69.9 | |
| LLaMA3.1-8B - ContextBase Model=LLaMA3.1-8B, Context Condition=Standard Context2025.05 | 81.6 | 5.3 | 86.9 |