DB Task on Lifelong Agent Bench Task
86Success RateQWEN3.5-397B-A17B
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| QWEN3.5-397B-A17BBackbone LLM=QWEN3.5-397B-A17B2026.06 | 86 | — | — | |
| OPD-Evolver-9BBackbone LLM=QWEN3.5-9B2026.06 | 84.5 | — | — | |
| EvolveRBackbone LLM=QWEN3.5-9B2026.06 | 82.5 | — | — | |
| MempBackbone LLM=QWEN3.5-9B2026.06 | 82 | — | — | |
| STEP-3.5-FLASH (196B)Backbone LLM=STEP-3.5-FLASH (196B)2026.06 | 81 | — | — | |
| MemEvolveBackbone LLM=QWEN3.5-9B2026.06 | 81 | — | — | |
| ReasoningBankBackbone LLM=QWEN3.5-9B2026.06 | 80.5 | — | — | |
| CheatsheetBackbone LLM=QWEN3.5-9B2026.06 | 79.5 | — | — | |
| No MemoryBackbone LLM=QWEN3.5-9B2026.06 | 75.5 | — | — | |
| OPD-Evolver-4BBackbone LLM=QWEN3-4B2026.06 | 74 | — | — | |
| ExpeLBackbone LLM=QWEN3.5-9B2026.06 | 74 | — | — | |
| MempBackbone LLM=QWEN3-4B2026.06 | 73 | — | — | |
| AWMBackbone LLM=QWEN3.5-9B2026.06 | 72.5 | — | — | |
| MemEvolveBackbone LLM=QWEN3-4B2026.06 | 72 | — | — | |
| EvolveRBackbone LLM=QWEN3-4B2026.06 | 71.5 | — | — | |
| ReasoningBankBackbone LLM=QWEN3-4B2026.06 | 70 | — | — | |
| CheatsheetBackbone LLM=QWEN3-4B2026.06 | 69 | — | — | |
| No MemoryBackbone LLM=QWEN3-4B2026.06 | 65 | — | — | |
| AWMBackbone LLM=QWEN3-4B2026.06 | 63 | — | — | |
| ExpeLBackbone LLM=QWEN3-4B2026.06 | 62.5 | — | — | |
| Mem0Model=GPT-4o-mini2026.01 | — | 92 | 92.6 | |
| MemPModel=GPT-4o-mini2026.01 | — | 96 | 96.6 | |
| MemRLModel=GPT-4o-mini2026.01 | — | 96 | 97.2 | |
| No MemoryModel=GPT-4o-mini2026.01 | — | 86 | — | |
| Pass@10Model=GPT-4o-mini2026.01 | — | — | 92.8 | |
| RAGModel=GPT-4o-mini2026.01 | — | 91.4 | 91.6 | |
| Self-RAGModel=GPT-4o-mini2026.01 | — | 89.1 | 89.8 |