Question Answering on ARC-C (Acc %, Avg Cost)
87.75AccuracyMACA (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MACA (Ours)Model=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✓2026.05 | 87.75 | 1,656.3 | |
| AgentPruneModel=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✗2026.05 | 86.09 | 2,691.3 | |
| AgentVerseModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 85.61 | 3,014.9 | |
| PuppeteerModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✓2026.05 | 85.57 | 3,753.3 | |
| SC (CoT×5)Model=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 84.16 | 1,545 | |
| MacNetModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 83.83 | 3,596.3 | |
| DyLANModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 83.33 | 3,471.6 | |
| CoTModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 83.17 | 443.7 | |
| Self-RefineModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 83.16 | 1,191.4 | |
| VanillaModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 83.09 | 279.6 | |
| ComplexCoTModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.05 | 82.18 | 883.1 | |
| MaASModel=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✗2026.05 | 43.83 | 2,674.7 |