Mathematical Reasoning on GSM8K (Accuracy, Steps, Speed)
82.56AccuracyCOVER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COVERBackbone=LLaDA-1.5-8B, Length=5122026.02 | 82.56 | 63.84 | 5.41 | |
| baselineBackbone=LLaDA-1.5-8B, Length=5122026.02 | 82.34 | 512 | 1 | |
| baselineBackbone=LLaDA-1.5-8B, Length=2562026.02 | 82.11 | 256 | 1 | |
| WINOBackbone=LLaDA-1.5-8B, Length=5122026.02 | 82.03 | 74.73 | 3.72 | |
| COVERBackbone=LLaDA-1.5-8B, Length=2562026.02 | 81.73 | 63.24 | 2.65 | |
| SaberBackbone=LLaDA-1.5-8B, Length=2562026.02 | 81.43 | 107.32 | 2.33 | |
| SaberBackbone=LLaDA-1.5-8B, Length=5122026.02 | 81.35 | 117.53 | 4.29 | |
| WINOBackbone=LLaDA-1.5-8B, Length=2562026.02 | 81.12 | 85.03 | 2.44 | |
| COVERBackbone=LLaDA-Ins-8B, Length=5122026.02 | 79.98 | 65.47 | 5.52 | |
| SaberBackbone=LLaDA-Ins-8B, Length=5122026.02 | 79.61 | 128.75 | 3.87 | |
| WINOBackbone=LLaDA-Ins-8B, Length=5122026.02 | 79.45 | 74.96 | 3.61 | |
| COVERBackbone=Dream-Ins-7B, Length=5122026.02 | 79.3 | 51.48 | 8.48 | |
| baselineBackbone=LLaDA-Ins-8B, Length=5122026.02 | 79.08 | 512 | 1 | |
| COVERBackbone=Dream-Ins-7B, Length=2562026.02 | 78.92 | 52.11 | 3.51 | |
| WINOBackbone=LLaDA-Ins-8B, Length=2562026.02 | 77.33 | 49.47 | 3.01 | |
| COVERBackbone=LLaDA-Ins-8B, Length=2562026.02 | 77.26 | 51.65 | 3.25 | |
| baselineBackbone=Dream-Ins-7B, Length=5122026.02 | 76.88 | 512 | 1 | |
| baselineBackbone=Dream-Ins-7B, Length=2562026.02 | 75.82 | 256 | 1 | |
| SaberBackbone=LLaDA-Ins-8B, Length=2562026.02 | 75.66 | 120.48 | 2.47 | |
| baselineBackbone=LLaDA-Ins-8B, Length=2562026.02 | 74.91 | 256 | 1 | |
| WINOBackbone=Dream-Ins-7B, Length=5122026.02 | 74.07 | 96.98 | 5.05 | |
| WINOBackbone=Dream-Ins-7B, Length=2562026.02 | 74 | 83 | 3.01 | |
| SaberBackbone=Dream-Ins-7B, Length=5122026.02 | 72.1 | 450.3 | 1.26 | |
| COVERBackbone=LLaDA-Base-8B, Length=5122026.02 | 71.42 | 105.15 | 3.17 | |
| SaberBackbone=Dream-Ins-7B, Length=2562026.02 | 71.04 | 203.55 | 1.34 | |
| COVERBackbone=LLaDA-Base-8B, Length=2562026.02 | 70.96 | 97.21 | 1.78 | |
| baselineBackbone=LLaDA-Base-8B, Length=5122026.02 | 70.74 | 512 | 1 | |
| baselineBackbone=LLaDA-Base-8B, Length=2562026.02 | 70.58 | 256 | 1 | |
| WINOBackbone=LLaDA-Base-8B, Length=2562026.02 | 70.43 | 106.76 | 1.09 | |
| SaberBackbone=LLaDA-Base-8B, Length=5122026.02 | 70.13 | 166.08 | 3.07 | |
| WINOBackbone=LLaDA-Base-8B, Length=5122026.02 | 70.05 | 128.3 | 1.49 | |
| SaberBackbone=LLaDA-Base-8B, Length=2562026.02 | 69.62 | 135.36 | 1.72 |