Mathematical Reasoning on GSM8K (Acc, NFE, T/F)
0.8152AccdUltra-coding
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| dUltra-codingGeneration length=256, Block size=32, Planner=Enabled2025.12 | 0.8152 | 23.54 | 8.4 | |
| dUltra-mathGeneration length=256, Block size=32, Planner=Enabled2025.12 | 0.8129 | 21.21 | 9.717 | |
| Fast-dLLMGeneration length=256, Block size=322025.12 | 0.7756 | 57.26 | 4.33 | |
| dParallelGeneration length=256, Block size=322025.12 | 0.771 | 28.47 | 7.17 | |
| dUltra-coding (w/o planner)Generation length=256, Block size=32, Planner=Disabled2025.12 | 0.7589 | 15.27 | 12.84 | |
| dUltra-math (w/o planner)Generation length=256, Block size=32, Planner=Disabled2025.12 | 0.7544 | 15.31 | 13.39 | |
| d3LLMGeneration length=256, Block size=322025.12 | 0.725 | 25.79 | 8.39 |