List your company
ResearchFormerly WizWand

Mathematics on GSM8K (3-shot)

92.27AccuracyWeDLM-8B
78.469282.052185.63589.2179Dec 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
WeDLM-8BInstruct Model=true, Model Category=WeDLM, Shot Configuration=3-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.1292.27
SDAR-8BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=3-shot, Inference Framework=JetEngine, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.1291.66
Qwen2.5-7BInstruct Model=true, Model Category=AR Baseline, Shot Configuration=3-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=5122025.1289.91
Qwen3-8BInstruct Model=true, Model Category=AR Baseline, Shot Configuration=3-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=5122025.1289.91
WeDLM-7BInstruct Model=true, Model Category=WeDLM, Shot Configuration=3-shot, Inference Framework=vLLM, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.1287.57
LLaDA-8BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=3-shot, Inference Framework=dInfer, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.1280.59
Dream-7BInstruct Model=true, Model Category=DLLM Baseline, Shot Configuration=3-shot, Inference Framework=dInfer, Sampling Temperature=0.1, Max Generation Length=512, Window Size (W)=6, Penalty Coefficient (λ)=0.12025.1279