Mathematical Reasoning on MATH500 (Acc (%), TPF, AUP)
63.6AccuracySDAR-8B-b32
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SDAR-8B-b32Model Category=Block-wise dLLMs, Evaluation Protocol=4-shot2026.03 | 63.6 | 4.81 | 299.5 | |
| LightningRL-8B-b32Model Category=Block-wise dLLMs, Evaluation Protocol=4-shot2026.03 | 63 | 6.28 | 407.5 | |
| Fast-dLLM-v2Model Category=Block-wise dLLMs, Evaluation Protocol=4-shot2026.03 | 48.7 | 2.61 | 126.7 | |
| Qwen-2.5-7B-itModel Category=AR Models, Evaluation Protocol=4-shot2026.03 | 41.4 | 1 | 41.1 | |
| EAGLE-3 (LLaMA-3.1)Model Category=AR Models, Evaluation Protocol=4-shot2026.03 | 39.8 | 5.72 | 142.1 | |
| DreamModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 39.6 | 1 | 39.6 | |
| dParallel-DreamModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 38.7 | 2.94 | 77.9 | |
| Fast-dLLM-DreamModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 38.3 | 1.78 | 55.2 | |
| d3LLM-DreamModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 38.2 | 3.92 | 97.5 | |
| LLaDAModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 32.2 | 1 | 32.2 | |
| Fast-dLLM-LLaDAModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 30.8 | 1.97 | 47.2 | |
| d3LLM-LLaDAModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 30.4 | 5.74 | 107.6 | |
| dParallel-LLaDAModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 30.2 | 3.17 | 64.5 | |
| D2F-LLaDAModel Category=dLLMs, Evaluation Protocol=4-shot2026.03 | 28.7 | 2.38 | 45.5 |