Embodied Task Execution on MEMENTO Utilization Stage, Single-memory
15.3Planning CyclesClaude-3.5-Sonnet
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Claude-3.5-SonnetStage=Utilization, Task Type (Memory)=Single2025.05 | 15.3 | 2,258.8 | 69.3 | -26.9 | 63.7 | -30.3 | |
| GPT-4oStage=Utilization, Task Type (Memory)=Single2025.05 | 16.1 | 2,450.8 | 88 | -8.3 | 85.1 | -9.9 | |
| Qwen-2.5-72bStage=Utilization, Task Type (Memory)=Single2025.05 | 17.5 | 2,691.2 | 72.6 | -20.9 | 67.2 | -23.8 | |
| Llama-3.1-70bStage=Utilization, Task Type (Memory)=Single2025.05 | 19 | 2,566.6 | 72.2 | -20.7 | 66.7 | -23.3 | |
| Llama-3.1-8bStage=Utilization, Task Type (Memory)=Single2025.05 | 19 | 3,131.7 | 48.1 | -30 | 35 | -33.5 | |
| Qwen-2.5-7bStage=Utilization, Task Type (Memory)=Single2025.05 | 21.8 | 3,271 | 39.1 | -25 | 27.4 | -25.8 |