List your company
ResearchFormerly WizWand

Math Reasoning on SVAMP (Acc, Avg Cost)

96Accuracy (%)MACA (Ours)
79.089683.479887.8792.2602May 25, 2026
Updated 5mo ago

Evaluation results

MethodLinks
MACA (Ours)Model=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✓2026.05962,057.2
PuppeteerModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✓2026.0594.184,204.7
MaASModel=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✗2026.0592.282,827.7
SC (CoT×5)Model=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0588.671,080.7
AgentPruneModel=Llama-3.1-8B, Structure Adaptation=✓, Orchestration Adaptation=✗2026.0588.442,780.8
ComplexCoTModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0586.332,658.9
DyLANModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0586.336,675.6
AgentVerseModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0586.034,184.7
Self-RefineModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0583.671,195.3
CoTModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0582.51267.8
VanillaModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0582.18209.6
MacNetModel=Llama-3.1-8B, Structure Adaptation=✗, Orchestration Adaptation=✗2026.0579.746,912.6