Code Generation on LiveCodeBench (LCB)
5.51SpeedupDFlash
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DFlashModel=Q3-8B, Temperature=0, Diffusion block size=162026.02 | 5.51 | 7.27 | |
| DFlashModel=Q3-4B, Temperature=0, Diffusion block size=162026.02 | 5.41 | 7.09 | |
| DFlashModel=Q3-8B, Temperature=1, Diffusion block size=162026.02 | 4.93 | 6.69 | |
| DFlashModel=Q3-4B, Temperature=1, Diffusion block size=162026.02 | 4.9 | 6.5 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=602026.02 | 1.9 | 3.22 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=602026.02 | 1.82 | 3.14 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=602026.02 | 1.81 | 3.03 | |
| EAGLE-3Model=Q3-4B, Temperature=0, Draft tree size=162026.02 | 1.73 | 2.91 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=602026.02 | 1.72 | 2.92 | |
| EAGLE-3Model=Q3-4B, Temperature=1, Draft tree size=162026.02 | 1.63 | 2.77 | |
| EAGLE-3Model=Q3-8B, Temperature=0, Draft tree size=162026.02 | 1.57 | 2.65 | |
| EAGLE-3Model=Q3-8B, Temperature=1, Draft tree size=162026.02 | 1.56 | 2.57 |