Mathematics on GSM8K (test)
84.99AccuracyQwen3-4B-Base
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-4B-BaseNumber of shots=42026.06 | 84.99 | |
| FReDA-4BNumber of shots=4, Evaluation protocol=Best-of-N2026.06 | 84.15 | |
| FReDA-4BNumber of shots=4, Evaluation protocol=Self-refine2026.06 | 83.55 | |
| Dream-7B-BaseNumber of shots=42026.06 | 81 | |
| TiDAR-8BNumber of shots=4, Evaluation protocol=Trust Diff2026.06 | 80.44 | |
| TiDAR-8BNumber of shots=4, Evaluation protocol=Trust AR2026.06 | 79.83 | |
| Qwen2.5-3B-BaseNumber of shots=42026.06 | 79.1 | |
| BlockDiff-4BNumber of shots=42026.06 | 77.33 | |
| LLaDA-8B-BaseNumber of shots=42026.06 | 74.37 | |
| LLaDA-MoE-7B-A1B-BaseNumber of shots=42026.06 | 66.41 | |
| DiffuLLaMA-7BNumber of shots=4, Note=fine-tuned setting2026.06 | 63.1 |