Mathematical Reasoning on MATH (Samples Required & Average Improvement)
7Samples RequiredAdaptive SC
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Adaptive SCSC@n=64, Model=Qwen-Math2025.11 | 7 | 4.36 | |
| Blend-ASCSC@n=64, Model=Qwen-Math2025.11 | 7 | 5.33 | |
| Fixed-AllocationSC@n=64, Model=Qwen-Math2025.11 | 10 | 4.09 | |
| Blend-ASCSC@n=128, Model=Qwen-Math2025.11 | 12 | 4.29 | |
| Adaptive SCSC@n=128, Model=Qwen-Math2025.11 | 13 | 2.13 | |
| Blend-ASCSC@n=64, Model=Llama-3B2025.11 | 14 | 5.33 | |
| Adaptive SCSC@n=64, Model=Llama-3B2025.11 | 16 | 4.36 | |
| Fixed-AllocationSC@n=64, Model=Llama-3B2025.11 | 18 | 4.09 | |
| Fixed-AllocationSC@n=128, Model=Qwen-Math2025.11 | 19 | 3.4 | |
| Blend-ASCSC@n=128, Model=Llama-3B2025.11 | 31 | 4.29 | |
| Fixed-AllocationSC@n=128, Model=Llama-3B2025.11 | 45 | 3.4 | |
| Adaptive SCSC@n=128, Model=Llama-3B2025.11 | 77 | 2.13 |