Mathematical Reasoning on MATH500 (Accuracy and Average metrics)
74AccuracyQwen2.5-7B-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5-7B-InstructArchitecture=Qwen2.5-7B, Training Stage=AR LLM2026.06 | 74 | 54.5 | |
| AGDOArchitecture=Dream-v0-Instruct-7B, Training Stage=RL, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 56.2 | 38.8 | |
| AGDO-SFTArchitecture=Dream-v0-Instruct-7B, Training Stage=SFT, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 53.7 | 36 | |
| AGDO-RLArchitecture=Dream-v0-Instruct-7B, Training Stage=RL, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 53.7 | 38.1 | |
| TraceRLArchitecture=Dream-v0-Instruct-7B, Training Stage=RL, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 52.8 | 36.5 | |
| Llama3.1-8B-InstructArchitecture=Llama3.1-8B, Training Stage=AR LLM2026.06 | 51.9 | 42.7 | |
| blockwise SFTArchitecture=Dream-v0-Instruct-7B, Training Stage=SFT, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 51.7 | 34.4 | |
| Coupled RLArchitecture=Dream-v0-Instruct-7B, Training Stage=RL, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 48.8 | 34.9 | |
| SFTArchitecture=Dream-v0-Instruct-7B, Training Stage=SFT, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 48.3 | 33.9 | |
| Diff-GRPOArchitecture=Dream-v0-Instruct-7B, Training Stage=RL, Sampling Temperature=0.1, Decoding Strategy=Static decoding, Max Response Length=1,0242026.06 | 45.5 | 35 | |
| Dream-v0-Instruct-7BArchitecture=Dream-v0-Instruct-7B, Training Stage=Masked DLLM2026.06 | 38.9 | 28.3 | |
| LLaDA-8B-InstructArchitecture=LLaDA-8B, Training Stage=Masked DLLM2026.06 | 38.3 | 28.5 |