Decision Making on ALFWorld, WebShop, ScienceWorld, and BabyAI (test)
66.42ALFWorld Success RateNPM + Workflows
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| NPM + WorkflowsModel=Qwen3-8B, Paradigm=Hybrid2026.06 | 66.42 | 53.94 | 31.89 | 15.31 | 41.89 | |
| WorkflowsModel=Qwen3-8B, Paradigm=Explicit2026.06 | 62.69 | 48.93 | 29.57 | 10.4 | 37.9 | |
| NPM + WorkflowsModel=Qwen3-4B, Paradigm=Hybrid2026.06 | 61.19 | 47.84 | 21.97 | 19.38 | 37.6 | |
| NPMModel=Qwen3-8B, Paradigm=Implicit2026.06 | 56.72 | 48.24 | 26.07 | 14.26 | 36.32 | |
| WorkflowsModel=Qwen3-4B, Paradigm=Explicit2026.06 | 52.99 | 45.73 | 23.59 | 14.6 | 34.23 | |
| Mass-MeanModel=Qwen3-8B, Paradigm=Implicit2026.06 | 49.25 | 44.26 | 25.32 | 8.71 | 31.89 | |
| CAAModel=Qwen3-8B, Paradigm=Implicit2026.06 | 47.01 | 20.66 | 9.17 | 14.31 | 22.79 | |
| InsightsModel=Qwen3-8B, Paradigm=Explicit2026.06 | 46.27 | 45.22 | 28.09 | 7.77 | 31.84 | |
| InsightsModel=Qwen3-4B, Paradigm=Explicit2026.06 | 44.03 | 40.72 | 22.59 | 12.09 | 29.86 | |
| NPMModel=Qwen3-4B, Paradigm=Implicit2026.06 | 40.3 | 48 | 18.2 | 19.04 | 31.39 | |
| No MemoryModel=Qwen3-8B, Paradigm=None2026.06 | 39.55 | 46.25 | 24.98 | 11.74 | 30.63 | |
| NPM + WorkflowsModel=MiniCPM3-4B, Paradigm=Hybrid2026.06 | 38.81 | 51.21 | 10.97 | 36.9 | 34.47 | |
| WorkflowsModel=MiniCPM3-4B, Paradigm=Explicit2026.06 | 32.84 | 54.97 | 10.5 | 32.39 | 32.68 | |
| NPMModel=MiniCPM3-4B, Paradigm=Implicit2026.06 | 31.34 | 43.53 | 8.7 | 31.91 | 28.87 | |
| No MemoryModel=Qwen3-4B, Paradigm=None2026.06 | 30.6 | 44.81 | 18.4 | 18.75 | 28.14 | |
| Mass-MeanModel=Qwen3-4B, Paradigm=Implicit2026.06 | 29.1 | 39.07 | 18.16 | 17.82 | 26.04 | |
| InsightsModel=MiniCPM3-4B, Paradigm=Explicit2026.06 | 28.36 | 47.96 | 10 | 27.78 | 28.53 | |
| Mass-MeanModel=MiniCPM3-4B, Paradigm=Implicit2026.06 | 26.87 | 34.21 | 8.02 | 29.73 | 24.71 | |
| CAAModel=Qwen3-4B, Paradigm=Implicit2026.06 | 26.87 | 25.52 | 11.48 | 3.48 | 16.84 | |
| No MemoryModel=MiniCPM3-4B, Paradigm=None2026.06 | 23.88 | 32.21 | 7.29 | 27 | 22.6 | |
| CAAModel=MiniCPM3-4B, Paradigm=Implicit2026.06 | 23.88 | 13.85 | 6.29 | 30.29 | 18.58 |