Code Generation on Code
98.7AccuracyM2CL
Evaluation results
| Method | Links | |
|---|---|---|
| M2CLModel=Qwen-14B, Number of LLMs=642026.02 | 98.7 | |
| M2CLModel=Qwen-72B, Number of LLMs=642026.02 | 97.5 | |
| M2CLModel=Llama-70B, Number of LLMs=162026.02 | 97.2 | |
| M2CLBackbone=Qwen-72B, Number of LLMs=322026.02 | 95.9 | |
| M2CLBackbone=Qwen-14B, Number of LLMs=322026.02 | 94.9 | |
| M2CLModel=Qwen-72B, Number of LLMs=162026.02 | 94.4 | |
| M2CLBackbone=Llama-70B, Number of LLMs=322026.02 | 93.7 | |
| M2CLModel=Qwen-14B, Number of LLMs=162026.02 | 93.3 | |
| M2CLModel=Llama-70B, Number of LLMs=642026.02 | 92 | |
| MacNetModel=Qwen-14B, Number of LLMs=642026.02 | 91.2 | |
| M2CLBackbone=Qwen-14B, Number of LLMs=82026.02 | 91.1 | |
| M2CLBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 91.1 | |
| M2CLBackbone=Qwen-72B, Number of LLMs=82026.02 | 90.7 | |
| M2CLBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 90.7 | |
| M2CLModel=Qwen-7B, Number of LLMs=642026.02 | 90.2 | |
| M2CLBase Model=Qwen-72B, Number of LLMs=42026.02 | 88.3 | |
| M2CLBackbone=Qwen-7B, Number of LLMs=322026.02 | 87.3 | |
| MacNetModel=Qwen-72B, Number of LLMs=642026.02 | 86.7 | |
| M2CLBase Model=Qwen-14B, Number of LLMs=42026.02 | 86.5 | |
| M2CLModel=Qwen-7B, Number of LLMs=162026.02 | 84.9 | |
| GPTSwarmModel=Qwen-72B, Number of LLMs=642026.02 | 84 | |
| DyLANModel=Qwen-72B, Number of LLMs=642026.02 | 83.9 | |
| MacNetBackbone=Qwen-14B, Number of LLMs=322026.02 | 83 | |
| DyLANBackbone=Qwen-72B, Number of LLMs=322026.02 | 82.7 | |
| M2CLModel=Llama-14B, Number of LLMs=642026.02 | 82.5 | |
| GPTSwarmBackbone=Qwen-72B, Number of LLMs=322026.02 | 82.2 | |
| DyLANModel=Qwen-72B, Number of LLMs=162026.02 | 81.4 | |
| GPTSwarmModel=Qwen-72B, Number of LLMs=162026.02 | 81.1 | |
| M2CLBackbone=Llama-70B, Number of LLMs=82026.02 | 81 | |
| DyLANBackbone=Qwen-72B, Number of LLMs=82026.02 | 80.4 | |
| DyLANBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 80.4 | |
| GPTSwarmModel=Qwen-14B, Number of LLMs=642026.02 | 80.4 | |
| M2CLBackbone=Qwen-7B, Number of LLMs=82026.02 | 80.3 | |
| M2CLBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 80.3 | |
| DyLANModel=Qwen-14B, Number of LLMs=642026.02 | 80.1 | |
| MacNetBackbone=Qwen-72B, Number of LLMs=322026.02 | 79.9 | |
| MacNetModel=Qwen-7B, Number of LLMs=642026.02 | 79.8 | |
| GPTSwarmBackbone=Qwen-72B, Number of LLMs=82026.02 | 79.6 | |
| GPTSwarmBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 79.6 | |
| DebateModel=Qwen-72B, Number of LLMs=642026.02 | 78.9 | |
| DyLANBackbone=Qwen-14B, Number of LLMs=322026.02 | 78.9 | |
| GPTSwarmBackbone=Qwen-14B, Number of LLMs=322026.02 | 78.9 | |
| GPTSwarmModel=Qwen-14B, Number of LLMs=162026.02 | 78.4 | |
| DyLANModel=Qwen-14B, Number of LLMs=162026.02 | 78.2 | |
| M2CLBase Model=Qwen-7B, Number of LLMs=42026.02 | 76.8 | |
| DyLANBackbone=Qwen-14B, Number of LLMs=82026.02 | 76.6 | |
| DyLANBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 76.6 | |
| GPTSwarmBackbone=Qwen-14B, Number of LLMs=82026.02 | 75.9 | |
| GPTSwarmBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 75.9 | |
| DebateModel=Qwen-14B, Number of LLMs=642026.02 | 75.8 | |
| M2CLBackbone=Llama-14B, Number of LLMs=322026.02 | 75.6 | |
| MacNetModel=Qwen-14B, Number of LLMs=162026.02 | 74.8 | |
| DebateBackbone=Qwen-72B, Number of LLMs=322026.02 | 74.5 | |
| MacNetBackbone=Qwen-7B, Number of LLMs=322026.02 | 73.7 | |
| MacNetModel=Qwen-72B, Number of LLMs=162026.02 | 72.6 | |
| BoNModel=Qwen-72B, Number of LLMs=162026.02 | 72.2 | |
| BoNBackbone=Qwen-72B, Number of LLMs=82026.02 | 72.2 | |
| Best-of-N (BoN)Backbone Model=Qwen-72B, Number of LLMs=42026.02 | 72.2 | |
| BoNModel=Qwen-72B, Number of LLMs=642026.02 | 72.2 | |
| BoNBackbone=Qwen-72B, Number of LLMs=322026.02 | 72.2 | |
| BoNBase Model=Qwen-72B, Number of LLMs=42026.02 | 72.2 | |
| DebateBackbone=Qwen-14B, Number of LLMs=322026.02 | 71.8 | |
| DebateModel=Qwen-72B, Number of LLMs=162026.02 | 71.6 | |
| DyLANBase Model=Qwen-72B, Number of LLMs=42026.02 | 71.3 | |
| M2CLBase Model=Llama-70B, Number of LLMs=42026.02 | 70.6 | |
| MacNetBackbone=Qwen-72B, Number of LLMs=82026.02 | 70.5 | |
| MacNetBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 70.5 | |
| MacNetBackbone=Qwen-14B, Number of LLMs=82026.02 | 70.4 | |
| MacNetBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 70.4 | |
| DebateModel=Qwen-14B, Number of LLMs=162026.02 | 70.1 | |
| GPTSwarmBase Model=Qwen-72B, Number of LLMs=42026.02 | 69.7 | |
| MacNetModel=Qwen-7B, Number of LLMs=162026.02 | 69.4 | |
| BoNModel=Qwen-14B, Number of LLMs=162026.02 | 69.4 | |
| BoNBackbone=Qwen-14B, Number of LLMs=82026.02 | 69.4 | |
| Best-of-N (BoN)Backbone Model=Qwen-14B, Number of LLMs=42026.02 | 69.4 | |
| BoNModel=Qwen-14B, Number of LLMs=642026.02 | 69.4 | |
| BoNBackbone=Qwen-14B, Number of LLMs=322026.02 | 69.4 | |
| BoNBase Model=Qwen-14B, Number of LLMs=42026.02 | 69.4 | |
| DebateBackbone=Qwen-72B, Number of LLMs=82026.02 | 69.1 | |
| DebateBackbone Model=Qwen-72B, Number of LLMs=42026.02 | 69.1 | |
| GPTSwarmBase Model=Qwen-14B, Number of LLMs=42026.02 | 68.1 | |
| MacNetBase Model=Qwen-72B, Number of LLMs=42026.02 | 68.1 | |
| GPTSwarmModel=Qwen-7B, Number of LLMs=642026.02 | 68 | |
| DyLANBase Model=Qwen-14B, Number of LLMs=42026.02 | 67.9 | |
| GPTSwarmBackbone=Qwen-7B, Number of LLMs=322026.02 | 67.8 | |
| DyLANModel=Qwen-7B, Number of LLMs=642026.02 | 67.5 | |
| DebateBackbone=Qwen-14B, Number of LLMs=82026.02 | 66.9 | |
| DebateBackbone Model=Qwen-14B, Number of LLMs=42026.02 | 66.9 | |
| DebateBase Model=Qwen-72B, Number of LLMs=42026.02 | 66.7 | |
| DebateModel=Qwen-7B, Number of LLMs=642026.02 | 66.6 | |
| DyLANBackbone=Qwen-7B, Number of LLMs=322026.02 | 66.5 | |
| GPTSwarmModel=Qwen-7B, Number of LLMs=162026.02 | 66.2 | |
| M2CLModel=Llama-14B, Number of LLMs=162026.02 | 66.1 | |
| GPT-42024.03 | 65.3 | |
| SkyworkSize=13B2024.03 | 64.9 | |
| DyLANModel=Qwen-7B, Number of LLMs=162026.02 | 64.8 | |
| DebateBackbone=Qwen-7B, Number of LLMs=322026.02 | 64.3 | |
| DyLANBackbone=Qwen-7B, Number of LLMs=82026.02 | 63.4 | |
| DyLANBackbone Model=Qwen-7B, Number of LLMs=42026.02 | 63.4 | |
| MacNetBase Model=Qwen-14B, Number of LLMs=42026.02 | 62.9 |