General Reasoning on HellaSwag 10-shot
92.12ScoreSDAR-8B
Evaluation results
| Method | Links | |
|---|---|---|
| SDAR-8BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=10-shot, Inference Framework=JetEngine, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.12 | 92.12 | |
| Qwen2.5-7BInstruct Model=true, Model Category=AR Baseline, Shot Configuration=10-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=5122025.12 | 87.59 | |
| Qwen3-8BInstruct Model=true, Model Category=AR Baseline, Shot Configuration=10-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=5122025.12 | 86.13 | |
| WeDLM-7BInstruct Model=true, Model Category=WeDLM, Shot Configuration=10-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.12 | 84.75 | |
| WeDLM-8BInstruct Model=true, Model Category=WeDLM, Shot Configuration=10-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.12 | 82.94 | |
| LLaDA-8BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=10-shot, Inference Framework=dInfer, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.12 | 78.55 | |
| Dream-7BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=10-shot, Inference Framework=dInfer, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.12 | 62 |