Embodied Agentic on PDDL
70.5AccuracyM2CL
Evaluation Results
| Method | Links | |
|---|---|---|
| M2CLBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 70.5 | |
| MacNetBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 53.7 | |
| Best-of-N (BoN)Backbone Model=Qwen-72B, Number of LLMs=42026.02 | 51 | |
| GPTSwarmBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 49.7 | |
| DebateBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 49.1 | |
| DyLANBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 45.5 | |
| M2CLBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 43 | |
| Single executionBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 41 | |
| M2CLBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 34.7 | |
| MacNetBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 32.7 | |
| DebateBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 30 | |
| MacNetBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 29.5 | |
| Best-of-N (BoN)Backbone Model=Qwen-14B, Number of LLMs=42026.02 | 28.5 | |
| GPTSwarmBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 28.4 | |
| DyLANBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 28 | |
| Best-of-N (BoN)Backbone Model=Qwen-7B, Number of LLMs=42026.02 | 26.3 | |
| Single executionBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 25.7 | |
| DebateBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 24.8 | |
| GPTSwarmBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 24.5 | |
| DyLANBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 23.4 | |
| Single executionBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 21 |