Enterprise Workflow Automation on WorkArena (test)
45.1M&D ScoreMem-π
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Mem-πBase Agent=gpt-5.4-mini, Memory Backbone=Qwen-2.5-7B-Instruct2026.05 | 45.1 | — | 70.6 | 13.6 | 85.3 | 50.3 | |
| Mem-π (Stage 1)Base Agent=gpt-5.4-mini, Memory Backbone=Qwen-2.5-7B-Instruct, Training Stage=Stage 12026.05 | 41.6 | — | 65.8 | 9 | 81.5 | 46.6 | |
| MemRLBase Agent=gpt-5.4-mini2026.05 | 36.5 | — | 63.6 | 10.6 | 80.5 | 46.1 | |
| Memory-R1Base Agent=gpt-5.4-mini, Memory Backbone=Qwen-2.5-7B-Instruct2026.05 | 35.4 | — | 62.3 | 10.5 | 80.5 | 44.3 | |
| Mem0Base Agent=gpt-5.4-mini, k=12026.05 | 33.9 | — | 61.8 | 9.5 | 79.1 | 44.1 | |
| RAGBase Agent=gpt-5.4-mini, k=12026.05 | 33.6 | — | 60.6 | 9 | 78.1 | 42.6 | |
| Base AgentBase Agent=gpt-5.4-mini2026.05 | 31.9 | — | 55.7 | 11.6 | 76.9 | 42 |