Mathematical Reasoning on GSM8K (Sample Size Sensitivity)
128Samples RequiredAdaptive SC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Adaptive SCSC@n=128, Model=Llama-3B2025.11 | 128 | 2.13 | |
| Fixed-AllocationSC@n=128, Model=Llama-3B2025.11 | 34 | 3.4 | |
| Blend-ASCSC@n=128, Model=Llama-3B2025.11 | 22 | 4.29 | |
| Fixed-AllocationSC@n=64, Model=Llama-3B2025.11 | 15 | 4.09 | |
| Fixed-AllocationSC@n=128, Model=Qwen-Math2025.11 | 14 | 3.4 | |
| Adaptive SCSC@n=64, Model=Llama-3B2025.11 | 13 | 4.36 | |
| Blend-ASCSC@n=64, Model=Llama-3B2025.11 | 11 | 5.33 | |
| Adaptive SCSC@n=128, Model=Qwen-Math2025.11 | 11 | 2.13 | |
| Fixed-AllocationSC@n=64, Model=Qwen-Math2025.11 | 9 | 4.09 | |
| Blend-ASCSC@n=128, Model=Qwen-Math2025.11 | 9 | 4.29 | |
| Adaptive SCSC@n=64, Model=Qwen-Math2025.11 | 6 | 4.36 | |
| Blend-ASCSC@n=64, Model=Qwen-Math2025.11 | 6 | 5.33 |