Embodied Agent Task on ALFWorld Unseen
79.1Success RateGRPO w/ EVU
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GRPO w/ EVUMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=GRPO, EVU Mechanism=Included2026.04 | 79.1 | — | |
| GRPOMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=GRPO, EVU Mechanism=None2026.04 | 70.8 | — | |
| PPO w/ EVUMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=PPO, EVU Mechanism=Included2026.04 | 58.2 | — | |
| SFT w/ EVUMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=SFT, EVU Mechanism=Included2026.04 | 56.7 | — | |
| PPOMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=PPO, EVU Mechanism=None2026.04 | 54.4 | — | |
| SFTMethod Category=Training, Backbone Model=Qwen2.5-3B-Instruct, Base Method=SFT, EVU Mechanism=None2026.04 | 50.7 | — | |
| ReAct w/ EVUMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=ReAct, EVU Mechanism=Included2026.04 | 49.8 | — | |
| GRPO w/ EVUMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=GRPO, EVU Mechanism=Included2026.04 | 49.3 | — | |
| ElasticMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 49 | 9,031 | |
| NoThinking w/ EVUMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=NoThinking, EVU Mechanism=Included2026.04 | 47.6 | — | |
| ReActMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=ReAct, EVU Mechanism=None2026.04 | 47.6 | — | |
| Plan-and-Act w/ EVUMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=Plan-and-Act, EVU Mechanism=Included2026.04 | 46.3 | — | |
| Plan-and-ActMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=Plan-and-Act, EVU Mechanism=None2026.04 | 44.8 | — | |
| GRPOMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=GRPO, EVU Mechanism=None2026.04 | 44 | — | |
| NoThinkingMethod Category=Prompting, Backbone Model=DeepSeek V3.2, Base Method=NoThinking, EVU Mechanism=None2026.04 | 42.3 | — | |
| ElasticMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 41 | 12,846 | |
| PPO w/ EVUMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=PPO, EVU Mechanism=Included2026.04 | 40.3 | — | |
| Mem0Backbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 27,327 | |
| MemoryOSBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 40 | 50,238 | |
| LightMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 37 | 10,617 | |
| MemGenBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 34 | 13,551 | |
| SFT w/ EVUMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=SFT, EVU Mechanism=Included2026.04 | 33.6 | — | |
| PPOMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=PPO, EVU Mechanism=None2026.04 | 32 | — | |
| LangMemBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 28 | 10,140 | |
| M+Backbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 28 | 13,382 | |
| MemGenBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 25 | 14,416 | |
| MemPBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 22 | 115,492 | |
| SFTMethod Category=Training, Backbone Model=Qwen3-1.7B-Instruct, Base Method=SFT, EVU Mechanism=None2026.04 | 20.1 | — | |
| AutoCompressorBackbone=Qwen2.5-7B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 20 | 19,317 | |
| MemoryBankBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 19 | 39,385 | |
| LightMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 17 | 12,617 | |
| M+Backbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 16 | 14,233 | |
| MemoryOSBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 13 | 65,845 | |
| AutoCompressorBackbone=Qwen2.5-3B-Instruct, Memory Space=Latent-Space, Few-shot setting=no-few-shot-example2026.05 | 13 | 21,571 | |
| Mem0Backbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 12 | 43,677 | |
| LangMemBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 11 | 12,449 | |
| MemPBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 10 | 110,019 | |
| MemoryBankBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 9 | 71,173 | |
| A-MEMBackbone=Qwen2.5-7B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 9 | 29,531 | |
| A-MEMBackbone=Qwen2.5-3B-Instruct, Memory Space=Text-Space, Few-shot setting=no-few-shot-example2026.05 | 5 | 14,248 |