Code Generation on MBPP base
80.7Pass@1SDAR-4B
Evaluation results
| Method | Links | |
|---|---|---|
| SDAR-4BScale=4B, Tokens=55B, FLOPs=1320, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 80.7 | |
| SDAR-8BScale=8B, Tokens=55B, FLOPs=2640, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 79.6 | |
| SDAR-1.7BScale=1.7B, Tokens=55B, FLOPs (1e18)=561.02026.06 | 68.5 | |
| Dream-7BScale=8B, Tokens=580B, FLOPs=24360, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 68.3 | |
| Fast-dLLM-v2-7BScale=8B, Tokens=1B, FLOPs=42, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 63 | |
| OPDLM-4BScale=4B, Tokens=0.076B, FLOPs=2.4, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 57.7 | |
| Simple-dLLMScale=0.6B, Tokens=46B, FLOPs (1e18)=165.62026.06 | 54 | |
| Fast-dLLM-v2-1.5BScale=1.5B, Tokens=1B, FLOPs (1e18)=9.02026.06 | 50 | |
| OPDLM-8BScale=8B, Tokens=0.066B, FLOPs=4.2, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 48.7 | |
| OPDLM-1.7BScale=1.7B, Tokens=0.072B, FLOPs (1e18)=0.982026.06 | 45 | |
| LLaDA-8BScale=8B, Tokens=1500B, FLOPs=72000, Decoding Strategy=greedy static decoding, Block Size=42026.06 | 31.5 | |
| OPDLM-0.6BScale=0.6B, Tokens=0.048B, FLOPs (1e18)=0.232026.06 | 24.9 |