General Performance Averaging on Consolidated Task Suite Avg.
77.6Average AccuracyPrimitives-based MAS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Primitives-based MASBackbone=Qwen3-14B2026.02 | 77.6 | 12 | |
| VotingBackbone=Qwen3-14B2026.02 | 74.3 | 8.8 | |
| LatentMASBackbone=Qwen3-14B2026.02 | 73.7 | 8.1 | |
| ReviewBackbone=Qwen3-14B2026.02 | 73 | 7.4 | |
| PlanningBackbone=Qwen3-14B2026.02 | 72.6 | 7.1 | |
| TextMASBackbone=Qwen3-14B2026.02 | 71.4 | 5.9 | |
| Mistral-7BRatio=0%, Backbone=Mistral-7B2026.03 | 70.1 | — | |
| Primitives-based MASBackbone=Qwen3-4B2026.02 | 69.6 | 13.9 | |
| VotingBackbone=Qwen3-4B2026.02 | 66 | 10.3 | |
| SingleBackbone=Qwen3-14B2026.02 | 65.5 | — | |
| LatentMASBackbone=Qwen3-4B2026.02 | 64.5 | 8.8 | |
| PlanningBackbone=Qwen3-4B2026.02 | 63.1 | 7.4 | |
| ReviewBackbone=Qwen3-4B2026.02 | 62.1 | 6.4 | |
| TextMASBackbone=Qwen3-4B2026.02 | 61.3 | 5.6 | |
| SoLARatio=20%, Backbone=Mistral-7B2026.03 | 58.1 | — | |
| SVD-LLMRatio=20%, Backbone=Mistral-7B2026.03 | 57.8 | — | |
| SingleBackbone=Qwen3-4B2026.02 | 55.7 | — | |
| SoLARatio=30%, Backbone=Mistral-7B2026.03 | 51.7 | — | |
| FLAPRatio=20%, Backbone=Mistral-7B2026.03 | 50 | — | |
| FLAPRatio=30%, Backbone=Mistral-7B2026.03 | 49.6 | — | |
| SVD-LLMRatio=30%, Backbone=Mistral-7B2026.03 | 49.1 | — | |
| SliceGPTRatio=20%, Backbone=Mistral-7B2026.03 | 42.7 | — | |
| SliceGPTRatio=30%, Backbone=Mistral-7B2026.03 | 35.8 | — |