Mathematical Reasoning on GSM8K (8-shot)
95.1AccuracyAuto-Judge
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Auto-JudgeThreshold=0.014, L=32, Model=Llama-3.1-8B/70B-Instruct2026.02 | 95.1 | 57.4 | — | — | |
| Auto-JudgeThreshold=0.022, L=32, Model=Llama-3.1-8B/70B-Instruct2026.02 | 94.3 | 62.2 | — | — | |
| Auto-Judge + DMThreshold=0.014, L=32, Model=Llama-3.1-8B/70B-Instruct, Dropout probability p_drop=0.3, K=52026.02 | 94.1 | 73.9 | 1.29 | — | |
| Auto-Judge + DMThreshold=0.022, L=32, Model=Llama-3.1-8B/70B-Instruct, Dropout probability p_drop=0.3, K=52026.02 | 93.9 | 77.6 | 1.21 | — | |
| Auto-Judge + DMThreshold=0.112, L=32, Model=Llama-3.1-8B/70B-Instruct, Dropout probability p_drop=0.3, K=52026.02 | 93 | 90.4 | 1.07 | — | |
| BF16Model=Qwen3-30B-A3B, Quantization=BF162026.04 | 92.4 | — | — | — | |
| Auto-JudgeThreshold=0.112, L=32, Model=Llama-3.1-8B/70B-Instruct2026.02 | 91.4 | 84.8 | — | — | |
| Auto-Judge + DMThreshold=0.281, L=32, Model=Llama-3.1-8B/70B-Instruct, Dropout probability p_drop=0.3, K=52026.02 | 90.7 | 95.9 | 1.06 | — | |
| Auto-JudgeThreshold=0.281, L=32, Model=Llama-3.1-8B/70B-Instruct2026.02 | 88.2 | 90.1 | — | — | |
| CodeQuantModel=Qwen3-30B-A3B, Quantization Setting=A4W4 Embedding-wise2026.04 | 86.7 | — | — | — | |
| Baseline+ParallelModel=LLaDA-8B-Instruct2026.03 | 81.43 | 12.44 | — | — | |
| d2CacheModel=LLaDA-8B-Instruct2026.03 | 81.35 | 47.03 | — | — | |
| Elastic-CacheModel=LLaDA-8B-Instruct2026.03 | 81.2 | 32.89 | — | — | |
| EntropyCacheModel=LLaDA-8B-Instruct2026.03 | 81.2 | 62.31 | — | — | |
| BaselineModel=LLaDA-8B-Instruct2026.03 | 81.12 | 2.07 | — | — | |
| Fast-dLLM (Dual)Model=LLaDA-8B-Instruct2026.03 | 80.44 | 41.68 | — | — | |
| BaselineModel=Dream-v0-Instruct-7B2026.03 | 78.01 | 2.51 | — | — | |
| Baseline+ParallelModel=Dream-v0-Instruct-7B2026.03 | 77.41 | 13.95 | — | — | |
| EntropyCacheModel=Dream-v0-Instruct-7B2026.03 | 75.74 | 60.01 | — | — | |
| Fast-dLLM (Dual)Model=Dream-v0-Instruct-7B2026.03 | 74.22 | 55.5 | — | — | |
| d2CacheModel=Dream-v0-Instruct-7B2026.03 | 73.69 | 49.59 | — | — | |
| Elastic-CacheModel=Dream-v0-Instruct-7B2026.03 | 69.37 | 36.95 | — | — | |
| QuaRotModel=Qwen3-30B-A3B, Quantization Setting=A4W4 Embedding-wise2026.04 | 50.8 | — | — | — | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=16, Bottleneck size (R)=322026.05 | 39.1 | — | — | 38.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=8, Bottleneck size (R)=322026.05 | 38.8 | — | — | 38.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=32, Bottleneck size (R)=322026.05 | 38.3 | — | — | 38.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=8, Bottleneck size (R)=162026.05 | 37.7 | — | — | 37.2 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=4, Bottleneck size (R)=162026.05 | 37.4 | — | — | 37.2 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=8, Bottleneck size (R)=82026.05 | 37.3 | — | — | 36.5 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=4, Bottleneck size (R)=322026.05 | 37.2 | — | — | 38.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=16, Bottleneck size (R)=162026.05 | 37.1 | — | — | 37.2 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=2, Bottleneck size (R)=42026.05 | 36.8 | — | — | 36.3 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=42026.05 | 36.5 | — | — | 36.3 | |
| BF16Model=DeepSeek-V2-Lite, Quantization=BF162026.04 | 36.4 | — | — | — | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=4, Bottleneck size (R)=82026.05 | 36.4 | — | — | 36.5 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=2, Bottleneck size (R)=82026.05 | 36 | — | — | 36.5 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=22026.05 | 35.9 | — | — | 35.3 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=2, Bottleneck size (R)=162026.05 | 35.9 | — | — | 37.2 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=322026.05 | 35.8 | — | — | 38.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=2, Bottleneck size (R)=322026.05 | 35.6 | — | — | 38.4 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=32, Bottleneck size (R)=322026.05 | 35.4 | — | — | 34.9 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=4, Bottleneck size (R)=42026.05 | 35.4 | — | — | 36.3 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=162026.05 | 35.3 | — | — | 37.2 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=82026.05 | 35.2 | — | — | 36.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=8, Bottleneck size (R)=82026.05 | 34.9 | — | — | 34.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=16, Bottleneck size (R)=162026.05 | 34.9 | — | — | 34.6 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=16, Bottleneck size (R)=322026.05 | 34.9 | — | — | 34.9 | |
| LoRAAdapter Type=LoRA, Rank (r)=2, Bottleneck size (R)=42026.05 | 34.8 | — | — | 34.4 | |
| LoRAAdapter Type=LoRA, Rank (r)=8, Bottleneck size (R)=162026.05 | 34.8 | — | — | 34.6 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=8, Bottleneck size (R)=162026.05 | 34.8 | — | — | 34.6 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=16, Bottleneck size (R)=162026.05 | 34.8 | — | — | 34.6 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=8, Bottleneck size (R)=82026.05 | 34.7 | — | — | 34.4 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=8, Bottleneck size (R)=322026.05 | 34.7 | — | — | 34.9 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=2, Bottleneck size (R)=22026.05 | 34.7 | — | — | 35.3 | |
| LoRAAdapter Type=LoRA, Rank (r)=4, Bottleneck size (R)=82026.05 | 34.6 | — | — | 34.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=32, Bottleneck size (R)=322026.05 | 34.6 | — | — | 34.5 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=4, Bottleneck size (R)=82026.05 | 34.6 | — | — | 34.4 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=4, Bottleneck size (R)=162026.05 | 34.6 | — | — | 34.6 | |
| LoRAAdapter Type=LoRA, Rank (r)=4, Bottleneck size (R)=162026.05 | 34.5 | — | — | 34.6 | |
| LoRAAdapter Type=LoRA, Rank (r)=16, Bottleneck size (R)=322026.05 | 34.5 | — | — | 34.5 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=2, Bottleneck size (R)=322026.05 | 34.5 | — | — | 34.9 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=322026.05 | 34.4 | — | — | 34.9 | |
| LoRAAdapter Type=LoRA, Rank (r)=4, Bottleneck size (R)=42026.05 | 34.3 | — | — | 34.4 | |
| LoRAAdapter Type=LoRA, Rank (r)=2, Bottleneck size (R)=322026.05 | 34.3 | — | — | 34.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=4, Bottleneck size (R)=322026.05 | 34.3 | — | — | 34.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=8, Bottleneck size (R)=322026.05 | 34.3 | — | — | 34.5 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=4, Bottleneck size (R)=42026.05 | 34.3 | — | — | 34 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=82026.05 | 34.2 | — | — | 34.5 | |
| LoRAAdapter Type=LoRA, Rank (r)=2, Bottleneck size (R)=82026.05 | 34.1 | — | — | 34.5 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=4, Bottleneck size (R)=322026.05 | 34.1 | — | — | 34.9 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=2, Bottleneck size (R)=42026.05 | 34 | — | — | 34 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=2, Bottleneck size (R)=162026.05 | 33.9 | — | — | 34.6 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=2, Bottleneck size (R)=82026.05 | 33.8 | — | — | 34.4 | |
| LoRAAdapter Type=LoRA, Rank (r)=2, Bottleneck size (R)=22026.05 | 33.6 | — | — | 33 | |
| LoRAAdapter Type=LoRA, Rank (r)=2, Bottleneck size (R)=162026.05 | 33.6 | — | — | 34.6 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=42026.05 | 33.5 | — | — | 34.4 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=2, Bottleneck size (R)=22026.05 | 33.5 | — | — | 33.2 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=42026.05 | 33.4 | — | — | 34 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=322026.05 | 33.3 | — | — | 34.5 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=82026.05 | 33.1 | — | — | 34.4 | |
| CodeQuantModel=DeepSeek-V2-Lite, Quantization Setting=A4W4 Embedding-wise2026.04 | 33 | — | — | — | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=22026.05 | 32.9 | — | — | 33.2 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=162026.05 | 32.9 | — | — | 34.6 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=162026.05 | 32.5 | — | — | 34.6 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=12026.05 | 32.4 | — | — | 32.4 | |
| LoRAAdapter Type=LoRA, Rank (r)=1, Bottleneck size (R)=22026.05 | 32.4 | — | — | 33 | |
| DyLoRAAdapter Type=DyLoRA, Rank (r)=1, Bottleneck size (R)=12026.05 | 32.4 | — | — | 32.4 | |
| MATRYOSHKALORAAdapter Type=MATRYOSHKALORA, Rank (r)=1, Bottleneck size (R)=12026.05 | 32.3 | — | — | 32.3 | |
| QuaRotModel=DeepSeek-V2-Lite, Quantization Setting=A4W4 Embedding-wise2026.04 | 23.1 | — | — | — |