Mathematical Reasoning on MATH500 (Accuracy, Steps, and Speed)
45.4AccuracyCOVER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COVERBackbone=Dream-Ins-7B, Length=5122026.02 | 45.4 | 143.91 | 2.95 | |
| SaberBackbone=Dream-Ins-7B, Length=5122026.02 | 45 | 352.11 | 1.59 | |
| WINOBackbone=Dream-Ins-7B, Length=5122026.02 | 44.4 | 204.58 | 2.38 | |
| COVERBackbone=Dream-Ins-7B, Length=2562026.02 | 43.6 | 105.3 | 1.84 | |
| COVERBackbone=LLaDA-1.5-8B, Length=5122026.02 | 42.6 | 111.05 | 2.82 | |
| WINOBackbone=Dream-Ins-7B, Length=2562026.02 | 42.4 | 139.64 | 1.77 | |
| baselineBackbone=Dream-Ins-7B, Length=5122026.02 | 42.4 | 512 | 1 | |
| SaberBackbone=Dream-Ins-7B, Length=2562026.02 | 42 | 172.76 | 1.56 | |
| WINOBackbone=LLaDA-1.5-8B, Length=5122026.02 | 41.4 | 122.32 | 2.59 | |
| SaberBackbone=LLaDA-1.5-8B, Length=5122026.02 | 41 | 213.55 | 2.37 | |
| COVERBackbone=LLaDA-Ins-8B, Length=5122026.02 | 40.8 | 99.97 | 3.62 | |
| baselineBackbone=LLaDA-1.5-8B, Length=5122026.02 | 40 | 512 | 1 | |
| baselineBackbone=Dream-Ins-7B, Length=2562026.02 | 40 | 256 | 1 | |
| WINOBackbone=LLaDA-Ins-8B, Length=5122026.02 | 39.2 | 115.69 | 2.33 | |
| SaberBackbone=LLaDA-Ins-8B, Length=5122026.02 | 38.2 | 170.12 | 2.92 | |
| baselineBackbone=LLaDA-Ins-8B, Length=5122026.02 | 36.9 | 512 | 1 | |
| COVERBackbone=LLaDA-1.5-8B, Length=2562026.02 | 36 | 66.17 | 2.66 | |
| SaberBackbone=LLaDA-1.5-8B, Length=2562026.02 | 35.8 | 132.51 | 2.34 | |
| baselineBackbone=LLaDA-1.5-8B, Length=2562026.02 | 35.2 | 256 | 1 | |
| WINOBackbone=LLaDA-1.5-8B, Length=2562026.02 | 34.6 | 96.73 | 2.05 | |
| COVERBackbone=LLaDA-Ins-8B, Length=2562026.02 | 32.8 | 68.05 | 2.52 | |
| COVERBackbone=LLaDA-Base-8B, Length=5122026.02 | 32.4 | 124.29 | 2.91 | |
| WINOBackbone=LLaDA-Ins-8B, Length=2562026.02 | 32.4 | 75.49 | 1.96 | |
| COVERBackbone=LLaDA-Base-8B, Length=2562026.02 | 32 | 87.66 | 2.08 | |
| SaberBackbone=LLaDA-Base-8B, Length=2562026.02 | 31.8 | 123.91 | 2.02 | |
| baselineBackbone=LLaDA-Base-8B, Length=5122026.02 | 31.8 | 512 | 1 | |
| SaberBackbone=LLaDA-Ins-8B, Length=2562026.02 | 31.8 | 130.66 | 2.25 | |
| WINOBackbone=LLaDA-Base-8B, Length=5122026.02 | 31.6 | 139.45 | 1.76 | |
| WINOBackbone=LLaDA-Base-8B, Length=2562026.02 | 30.8 | 102.3 | 1.16 | |
| baselineBackbone=LLaDA-Base-8B, Length=2562026.02 | 30.6 | 256 | 1 | |
| baselineBackbone=LLaDA-Ins-8B, Length=2562026.02 | 30.5 | 256 | 1 | |
| SaberBackbone=LLaDA-Base-8B, Length=5122026.02 | 30.2 | 181.98 | 2.8 |