Automated Planning on PDDL
83.9AccuracyM2CL
Evaluation results
| Method | Links | |
|---|---|---|
| M2CLModel=Qwen-72B, Number of LLMs=642026.02 | 83.9 | |
| M2CLModel=Llama-70B, Number of LLMs=642026.02 | 82.2 | |
| M2CLBackbone=Qwen-72B, Number of LLMs=322026.02 | 80 | |
| M2CLBackbone=Llama-70B, Number of LLMs=322026.02 | 79.8 | |
| M2CLModel=Llama-70B, Number of LLMs=162026.02 | 78.1 | |
| MacNetModel=Llama-70B, Number of LLMs=642026.02 | 75.4 | |
| M2CLModel=Qwen-72B, Number of LLMs=162026.02 | 74.3 | |
| M2CLBackbone=Llama-70B, Number of LLMs=82026.02 | 73.6 | |
| MacNetBackbone=Llama-70B, Number of LLMs=322026.02 | 71.6 | |
| M2CLBackbone=Qwen-72B, Number of LLMs=82026.02 | 70.5 | |
| MacNetModel=Llama-70B, Number of LLMs=162026.02 | 67.1 | |
| MacNetModel=Qwen-72B, Number of LLMs=642026.02 | 66.6 | |
| M2CLBase Model=Llama-70B, Number of LLMs=42026.02 | 66.5 | |
| M2CLBase Model=Qwen-72B, Number of LLMs=42026.02 | 65.3 | |
| MacNetBackbone=Llama-70B, Number of LLMs=82026.02 | 62.6 | |
| MacNetBackbone=Qwen-72B, Number of LLMs=322026.02 | 62.3 | |
| MacNetModel=Qwen-72B, Number of LLMs=162026.02 | 58.1 | |
| MacNetBase Model=Llama-70B, Number of LLMs=42026.02 | 57 | |
| BoNModel=Qwen-72B, Number of LLMs=642026.02 | 54.4 | |
| MacNetBackbone=Qwen-72B, Number of LLMs=82026.02 | 53.7 | |
| DebateBackbone=Llama-70B, Number of LLMs=322026.02 | 53.7 | |
| DebateBackbone=Llama-70B, Number of LLMs=82026.02 | 53.3 | |
| BoNBackbone=Qwen-72B, Number of LLMs=322026.02 | 53.3 | |
| DebateModel=Llama-70B, Number of LLMs=642026.02 | 53.2 | |
| BoNBackbone=Llama-70B, Number of LLMs=322026.02 | 53.2 | |
| BoNModel=Llama-70B, Number of LLMs=162026.02 | 53 | |
| DebateBase Model=Llama-70B, Number of LLMs=42026.02 | 52.9 | |
| DebateModel=Llama-70B, Number of LLMs=162026.02 | 52.8 | |
| BoNBackbone=Llama-70B, Number of LLMs=82026.02 | 52.8 | |
| BoNBase Model=Llama-70B, Number of LLMs=42026.02 | 52.8 | |
| BoNModel=Llama-70B, Number of LLMs=642026.02 | 52.7 | |
| GPTSwarmModel=Qwen-72B, Number of LLMs=642026.02 | 52.5 | |
| BoNModel=Qwen-72B, Number of LLMs=162026.02 | 52.3 | |
| GPTSwarmBackbone=Llama-70B, Number of LLMs=82026.02 | 52.2 | |
| GPTSwarmModel=Llama-70B, Number of LLMs=162026.02 | 51.6 | |
| GPTSwarmBackbone=Llama-70B, Number of LLMs=322026.02 | 51.6 | |
| GPTSwarmBase Model=Llama-70B, Number of LLMs=42026.02 | 51.5 | |
| GPTSwarmBackbone=Qwen-72B, Number of LLMs=322026.02 | 51.4 | |
| GPTSwarmModel=Llama-70B, Number of LLMs=642026.02 | 51.3 | |
| BoNBackbone=Qwen-72B, Number of LLMs=82026.02 | 51 | |
| M2CLModel=Qwen-14B, Number of LLMs=642026.02 | 50.9 | |
| GPTSwarmModel=Qwen-72B, Number of LLMs=162026.02 | 50.6 | |
| DebateModel=Qwen-72B, Number of LLMs=642026.02 | 50.5 | |
| DyLANModel=Llama-70B, Number of LLMs=642026.02 | 50.4 | |
| DyLANBase Model=Llama-70B, Number of LLMs=42026.02 | 50.3 | |
| DebateBackbone=Qwen-72B, Number of LLMs=322026.02 | 50.2 | |
| M2CLModel=Llama-14B, Number of LLMs=642026.02 | 49.8 | |
| BoNBase Model=Qwen-72B, Number of LLMs=42026.02 | 49.8 | |
| MacNetBase Model=Qwen-72B, Number of LLMs=42026.02 | 49.8 | |
| DyLANModel=Llama-70B, Number of LLMs=162026.02 | 49.7 | |
| DyLANBackbone=Llama-70B, Number of LLMs=82026.02 | 49.7 | |
| GPTSwarmBackbone=Qwen-72B, Number of LLMs=82026.02 | 49.7 | |
| DyLANBackbone=Llama-70B, Number of LLMs=322026.02 | 49.7 | |
| M2CLBackbone=Qwen-14B, Number of LLMs=322026.02 | 49.6 | |
| DebateModel=Qwen-72B, Number of LLMs=162026.02 | 49.3 | |
| DebateBackbone=Qwen-72B, Number of LLMs=82026.02 | 49.1 | |
| GPTSwarmBase Model=Qwen-72B, Number of LLMs=42026.02 | 48.8 | |
| SingleBase Model=Llama-70B, Number of LLMs=12026.02 | 48.4 | |
| M2CLBackbone=Llama-14B, Number of LLMs=322026.02 | 48 | |
| DebateBase Model=Qwen-72B, Number of LLMs=42026.02 | 47.8 | |
| DyLANModel=Qwen-72B, Number of LLMs=642026.02 | 47.7 | |
| SingleBackbone=Llama-70B, Number of LLMs=82026.02 | 47.1 | |
| SingleModel=Llama-70B, Number of LLMs=12026.02 | 46.8 | |
| DyLANBackbone=Qwen-72B, Number of LLMs=322026.02 | 46.7 | |
| DyLANModel=Qwen-72B, Number of LLMs=162026.02 | 46.3 | |
| M2CLModel=Qwen-14B, Number of LLMs=162026.02 | 46 | |
| SingleBackbone=Llama-70B, Number of LLMs=322026.02 | 46 | |
| SingleModel=Llama-70B, Number of LLMs=642026.02 | 45.9 | |
| DyLANBase Model=Qwen-72B, Number of LLMs=42026.02 | 45.9 | |
| M2CLModel=Llama-14B, Number of LLMs=162026.02 | 45.5 | |
| DyLANBackbone=Qwen-72B, Number of LLMs=82026.02 | 45.5 | |
| MacNetModel=Llama-14B, Number of LLMs=642026.02 | 44 | |
| M2CLBackbone=Llama-14B, Number of LLMs=82026.02 | 43.8 | |
| M2CLBackbone=Qwen-14B, Number of LLMs=82026.02 | 43 | |
| MacNetBackbone=Llama-14B, Number of LLMs=322026.02 | 42.3 | |
| M2CLModel=Qwen-7B, Number of LLMs=642026.02 | 42.2 | |
| SingleBase Model=Qwen-72B, Number of LLMs=12026.02 | 41.8 | |
| SingleBackbone=Qwen-72B, Number of LLMs=82026.02 | 41 | |
| M2CLModel=Llama-7B, Number of LLMs=642026.02 | 40.9 | |
| M2CLBase Model=Llama-14B, Number of LLMs=42026.02 | 40.9 | |
| SingleModel=Qwen-72B, Number of LLMs=12026.02 | 40.8 | |
| SingleModel=Qwen-72B, Number of LLMs=642026.02 | 40.4 | |
| M2CLBackbone=Qwen-7B, Number of LLMs=322026.02 | 40.2 | |
| SingleBackbone=Qwen-72B, Number of LLMs=322026.02 | 40.1 | |
| MacNetModel=Llama-14B, Number of LLMs=162026.02 | 39.9 | |
| M2CLBase Model=Qwen-14B, Number of LLMs=42026.02 | 39.7 | |
| M2CLBackbone=Llama-7B, Number of LLMs=322026.02 | 38.9 | |
| MacNetModel=Llama-7B, Number of LLMs=642026.02 | 38.4 | |
| MacNetModel=Qwen-14B, Number of LLMs=642026.02 | 38.4 | |
| MacNetBackbone=Llama-7B, Number of LLMs=322026.02 | 37.5 | |
| M2CLModel=Qwen-7B, Number of LLMs=162026.02 | 37.4 | |
| MacNetModel=Qwen-7B, Number of LLMs=642026.02 | 37.1 | |
| M2CLModel=Llama-7B, Number of LLMs=162026.02 | 37 | |
| MacNetBackbone=Llama-14B, Number of LLMs=82026.02 | 37 | |
| MacNetBackbone=Qwen-14B, Number of LLMs=322026.02 | 36.2 | |
| MacNetBase Model=Llama-14B, Number of LLMs=42026.02 | 35.3 | |
| BoNBackbone=Llama-14B, Number of LLMs=82026.02 | 34.8 | |
| M2CLBackbone=Llama-7B, Number of LLMs=82026.02 | 34.7 | |
| M2CLBackbone=Qwen-7B, Number of LLMs=82026.02 | 34.7 | |
| BoNBackbone=Llama-14B, Number of LLMs=322026.02 | 34.3 |