Mathematical Reasoning on GSM-Hard (Accuracy and Cost)
63.28AccuracyMACA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MACABackbone=Qwen2.5-14B-Instruct2026.05 | 63.28 | 2,966.4 | |
| MaASBackbone=Qwen2.5-14B-Instruct2026.05 | 61.37 | 3,784.3 | |
| AgentPruneBackbone=Qwen2.5-14B-Instruct2026.05 | 55.92 | 4,236.5 | |
| DyLANBackbone=Qwen2.5-14B-Instruct2026.05 | 52.64 | 13,926.8 | |
| CoTBackbone=Qwen2.5-14B-Instruct2026.05 | 51.28 | 391.4 | |
| VanillaBackbone=Qwen2.5-14B-Instruct2026.05 | 47.36 | 266.8 |