Mathematical Reasoning on GSM8K (Acc, Steps, Speed)
83.9AccuracyASRD
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ASRDModel=LLaDA-1.5-8B, Sequence Length=5122026.06 | 83.9 | 71.6 | 6.4 | |
| BaselineModel=LLaDA-1.5-8B, Sequence Length=5122026.06 | 82.9 | 494.2 | 1 | |
| ASRDModel=LLaDA-1.5-8B, Sequence Length=2562026.06 | 81.1 | 44.1 | 5.1 | |
| BaselineModel=LLaDA-1.5-8B, Sequence Length=2562026.06 | 79.2 | 236.4 | 1 | |
| ASRDModel=Dream-Base-7B, Sequence Length=5122026.06 | 77.8 | 138.4 | 3.3 | |
| ASRDModel=Dream-Base-7B, Sequence Length=2562026.06 | 76.3 | 116.2 | 1.9 | |
| BaselineModel=Dream-Base-7B, Sequence Length=5122026.06 | 75.5 | 493.3 | 1 | |
| BaselineModel=Dream-Base-7B, Sequence Length=2562026.06 | 75.2 | 237.5 | 1 | |
| ASRDModel=LLaDA-Base-8B, Sequence Length=5122026.06 | 71.8 | 158.7 | 2.9 | |
| ASRDModel=LLaDA-Base-8B, Sequence Length=2562026.06 | 71.3 | 125.3 | 1.8 | |
| BaselineModel=LLaDA-Base-8B, Sequence Length=5122026.06 | 70.8 | 496.5 | 1 | |
| BaselineModel=LLaDA-Base-8B, Sequence Length=2562026.06 | 69.1 | 237.2 | 1 |