Multitask LLM Evaluation on MMLU, GSM8K, and HumanEval
88.33Average AccuracyVanilla MAS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Vanilla MASBackbone=Qwen2.5-72B-Instruct, Topology=Random, Training-Free (TF)=true2026.05 | 88.33 | 171.94 | 0.51 | |
| AgentDropoutBackbone=Qwen2.5-72B-Instruct, Topology=FullConnected, Training-Free (TF)=false2026.05 | 88.25 | 155.81 | 0.57 | |
| Vanilla MASBackbone=Qwen2.5-72B-Instruct, Topology=Star, Training-Free (TF)=true2026.05 | 87.96 | 212.25 | 0.41 | |
| Vanilla MASBackbone=Qwen2.5-72B-Instruct, Topology=Layered, Training-Free (TF)=true2026.05 | 87.62 | 174.06 | 0.5 | |
| AgentDropoutBackbone=Qwen2.5-72B-Instruct, Topology=Star, Training-Free (TF)=false2026.05 | 87.42 | 155.33 | 0.56 | |
| Vanilla MASBackbone=Qwen2.5-72B-Instruct, Topology=Chain, Training-Free (TF)=true2026.05 | 87.26 | 192.68 | 0.45 | |
| AgentDropoutBackbone=Qwen2.5-72B-Instruct, Topology=Layered, Training-Free (TF)=false2026.05 | 87.08 | 137.84 | 0.63 | |
| SC-CoTBackbone=Qwen2.5-72B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 86.95 | 91.45 | — | |
| Vanilla MASBackbone=Qwen2.5-72B-Instruct, Topology=FullConnected, Training-Free (TF)=true2026.05 | 86.91 | 196.87 | 0.44 | |
| AgentDropoutBackbone=Qwen2.5-72B-Instruct, Topology=Random, Training-Free (TF)=false2026.05 | 86.88 | 132.61 | 0.66 | |
| LLM-DebateBackbone=Qwen2.5-72B-Instruct, Topology=Debate, Training-Free (TF)=true2026.05 | 86.47 | 170.19 | 0.51 | |
| CONCATBackbone=Qwen2.5-14B-Instruct, Topology=Hybrid, Training-Free (TF)=true2026.05 | 86.02 | 30.17 | 2.85 | |
| CONCATBackbone=Qwen2.5-72B-Instruct, Topology=Hybrid, Training-Free (TF)=true2026.05 | 85.77 | 98.54 | 0.87 | |
| AgentDropoutBackbone=Qwen2.5-72B-Instruct, Topology=Chain, Training-Free (TF)=false2026.05 | 85.45 | 158.85 | 0.54 | |
| LLM-DebateBackbone=Qwen2.5-14B-Instruct, Topology=Debate, Training-Free (TF)=true2026.05 | 85.34 | 60.43 | 1.41 | |
| CoTBackbone=Qwen2.5-72B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 85.24 | 24.03 | — | |
| Vanilla MASBackbone=Qwen2.5-14B-Instruct, Topology=Star, Training-Free (TF)=true2026.05 | 85.15 | 68.33 | 1.25 | |
| SC-CoTBackbone=Qwen2.5-14B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 85.11 | 30.42 | — | |
| AgentDropoutBackbone=Qwen2.5-14B-Instruct, Topology=Star, Training-Free (TF)=false2026.05 | 85.05 | 48.04 | 1.77 | |
| Vanilla MASBackbone=Qwen2.5-14B-Instruct, Topology=Chain, Training-Free (TF)=true2026.05 | 84.89 | 57.56 | 1.47 | |
| AgentDropoutBackbone=Qwen2.5-14B-Instruct, Topology=FullConnected, Training-Free (TF)=false2026.05 | 84.88 | 48.69 | 1.74 | |
| Vanilla MASBackbone=Qwen2.5-14B-Instruct, Topology=Random, Training-Free (TF)=true2026.05 | 84.86 | 62.07 | 1.37 | |
| AgentDropoutBackbone=Qwen2.5-14B-Instruct, Topology=Layered, Training-Free (TF)=false2026.05 | 84.74 | 51.3 | 1.65 | |
| Vanilla MASBackbone=Qwen2.5-14B-Instruct, Topology=Layered, Training-Free (TF)=true2026.05 | 84.69 | 62.6 | 1.35 | |
| Vanilla MASBackbone=Qwen2.5-14B-Instruct, Topology=FullConnected, Training-Free (TF)=true2026.05 | 84.43 | 69.14 | 1.22 | |
| AgentDropoutBackbone=Qwen2.5-14B-Instruct, Topology=Chain, Training-Free (TF)=false2026.05 | 84.24 | 46.88 | 1.8 | |
| AgentDropoutBackbone=Qwen2.5-14B-Instruct, Topology=Random, Training-Free (TF)=false2026.05 | 83.36 | 46.85 | 1.78 | |
| CoTBackbone=Qwen2.5-14B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 74.79 | 7.64 | — | |
| AgentDropoutBackbone=Llama3-8B-Instruct, Topology=Chain, Training-Free (TF)=false2026.05 | 65.79 | 76.6 | 0.86 | |
| LLM-DebateBackbone=Llama3-8B-Instruct, Topology=Debate, Training-Free (TF)=true2026.05 | 65.37 | 93.78 | 0.7 | |
| CONCATBackbone=Llama3-8B-Instruct, Topology=Hybrid, Training-Free (TF)=true2026.05 | 64.97 | 41.73 | 1.56 | |
| AgentDropoutBackbone=Llama3-8B-Instruct, Topology=Random, Training-Free (TF)=false2026.05 | 64.56 | 69.98 | 0.92 | |
| Vanilla MASBackbone=Llama3-8B-Instruct, Topology=Layered, Training-Free (TF)=true2026.05 | 64.12 | 102.96 | 0.62 | |
| AgentDropoutBackbone=Llama3-8B-Instruct, Topology=Star, Training-Free (TF)=false2026.05 | 63.19 | 71.11 | 0.89 | |
| SC-CoTBackbone=Llama3-8B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 62.7 | 25.11 | — | |
| Vanilla MASBackbone=Llama3-8B-Instruct, Topology=FullConnected, Training-Free (TF)=true2026.05 | 62.3 | 103.87 | 0.6 | |
| Vanilla MASBackbone=Llama3-8B-Instruct, Topology=Chain, Training-Free (TF)=true2026.05 | 62.17 | 81.45 | 0.76 | |
| AgentDropoutBackbone=Llama3-8B-Instruct, Topology=FullConnected, Training-Free (TF)=false2026.05 | 62.03 | 92.28 | 0.67 | |
| Vanilla MASBackbone=Llama3-8B-Instruct, Topology=Star, Training-Free (TF)=true2026.05 | 62 | 105.43 | 0.59 | |
| AgentDropoutBackbone=Llama3-8B-Instruct, Topology=Layered, Training-Free (TF)=false2026.05 | 61.21 | 87.39 | 0.7 | |
| Vanilla MASBackbone=Llama3-8B-Instruct, Topology=Random, Training-Free (TF)=true2026.05 | 61.14 | 92.87 | 0.66 | |
| CoTBackbone=Llama3-8B-Instruct, Topology=-, Training-Free (TF)=true2026.05 | 58.9 | 6.05 | — |