Symbolic Planning on PDDL
30.39ScoreSimpleMem
Evaluation Results
| Method | Links | |
|---|---|---|
| SimpleMemMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 30.39 | |
| ConMemMAS=CAMEL, Atom.=✓, Coord.=✓, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 28.48 | |
| ReMe (dynamic)MAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 28.42 | |
| LatentMemMAS=CAMEL, Atom.=–, Coord.=✓, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 28.12 | |
| ConMemMAS=AutoGen, Atom.=✓, Coord.=✓, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 27.9 | |
| ReMe (dynamic)MAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 27.41 | |
| ConMemMAS=MacNet, Atom.=✓, Coord.=✓, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 27.07 | |
| ReMe (dynamic)MAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 26.27 | |
| LatentMemMAS=MacNet, Atom.=–, Coord.=✓, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 25.13 | |
| G-MemoryMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 24.56 | |
| SimpleMemMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 24.38 | |
| VoyagerMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 23.65 | |
| LatentMemMAS=AutoGen, Atom.=–, Coord.=✓, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 23.49 | |
| OAgentsMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 22.83 | |
| MetaGPTMAS=CAMEL, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 22.55 | |
| No-memoryMAS=CAMEL, Atom.=–, Coord.=–, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 22.1 | |
| G-MemoryMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 21.82 | |
| JoyAgentMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 21.2 | |
| No-memoryMAS=MacNet, Atom.=–, Coord.=–, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 20.73 | |
| SimpleMemMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 20.67 | |
| JoyAgentMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 20.65 | |
| ChatDevMAS=CAMEL, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 18.58 | |
| MetaGPTMAS=MacNet, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 17.81 | |
| GenerativeMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 17.29 | |
| G-MemoryMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 17.06 | |
| GenerativeMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 16.81 | |
| OAgentsMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 16.7 | |
| No-memoryMAS=AutoGen, Atom.=–, Coord.=–, T-free=–, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 16.39 | |
| ChatDevMAS=MacNet, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 15.85 | |
| ChatDevMAS=AutoGen, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 15.22 | |
| VoyagerMAS=MacNet, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 14.75 | |
| JoyAgentMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 14.26 | |
| GenerativeMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 13.94 | |
| OAgentsMAS=CAMEL, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 13.89 | |
| VoyagerMAS=AutoGen, Atom.=✓, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 13.62 | |
| MetaGPTMAS=AutoGen, Atom.=–, Coord.=–, T-free=✓, Backbone=Qwen/Qwen3-4B-Instruct-25072026.06 | 11.95 |