List your company
ResearchFormerly WizWand

Agentic Task on ALFWorld Unseen

88.1Success Rate (SR)ExpGraph
8.12428.88749.6570.413May 29, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ExpGraphExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM)2026.0588.117
IRCoTExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0587.319.6
ReasoningBankExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0581.324.1
AWMExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0580.618.8
S3Executor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0580.621.5
Search-o1Executor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0579.423.5
ExpGraphExecutor LLM=Qwen3-32B (Small LLM)2026.0575.418
MemRLExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0571.626.1
LightMemExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0570.927.8
No-MemoryExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=No-Memory2026.0564.926.3
ReActExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Prompt-based Agentic Baselines2026.0563.425.1
ExpeLExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0563.428.7
Mem0Executor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0563.422.4
ReflexionExecutor LLM=Gemini-3.1-Flash-Lite (Large LLM), Method Strategy Category=Prompt-based Agentic Baselines2026.0560.423.7
ReActExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Prompt-based Agentic Baselines2026.054738.6
S3Executor LLM=Qwen3-32B (Small LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0542.522.5
ReflexionExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Prompt-based Agentic Baselines2026.0540.338.7
No-MemoryExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=No-Memory2026.0535.842.5
AWMExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0532.840.1
ExpeLExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0529.141.4
IRCoTExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0527.640.6
ReasoningBankExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0526.142.6
LightMemExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.052539.2
MemRLExecutor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0520.249.6
Mem0Executor LLM=Qwen3-32B (Small LLM), Method Strategy Category=Retrieval-Centric Experience Learning Baselines2026.0518.742.8
Search-o1Executor LLM=Qwen3-32B (Small LLM), Method Strategy Category=LLM-Centric Experience Learning Baselines2026.0511.247.3