Accuracy on ARC-E (Question Answering)
87Accuracy (ARC-E)DreamReasoner-8B
Evaluation results
| Method | Links | |
|---|---|---|
| DreamReasoner-8BType=Block Diffusion2026.06 | 87 | |
| Dream-v0-7BType=Diffusion2026.06 | 83.9 | |
| Qwen3-8BType=AR2026.06 | 81.6 | |
| OLMo3-7BType=AR2026.06 | 80.6 | |
| Qwen2.5-7BType=AR2026.06 | 77.4 | |
| MiMo-7BType=AR2026.06 | 76.5 | |
| LLaDA-8BType=Diffusion2026.06 | 71.8 | |
| ADAMW (DENSE all-reduce)Protocol=Zero-shot, Model=GPT-345M, Strategy=DENSE all-reduce2026.07 | 48.82 | |
| SCAPE (d = 0.1)Protocol=Zero-shot, Model=GPT-345M, d=0.12026.07 | 48.82 | |
| ADAMS (DENSE all-reduce)Protocol=Zero-shot, Model=GPT-345M, Strategy=DENSE all-reduce2026.07 | 47.77 | |
| SCAPE (d = 0.01)Protocol=Zero-shot, Model=GPT-345M, d=0.012026.07 | 46.93 |