Code Generation on HumanEval (M, Speedup)
16.47Functional Score MDOUBLE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DOUBLEBase Model=Deepseek-33B2026.01 | 16.47 | 4.45 | |
| PEARLBase Model=Deepseek-33B2026.01 | 14.51 | 3.49 | |
| DOUBLEBase Model=LLaMA3.3-70B2026.01 | 14.35 | 5.33 | |
| DOUBLEBase Model=Qwen3-14B2026.01 | 12.65 | 1.65 | |
| PEARLBase Model=LLaMA3.3-70B2026.01 | 10.69 | 4.39 | |
| DOUBLEBase Model=Qwen3-32B2026.01 | 10.09 | 2.84 | |
| DOUBLEBase Model=LLaMA2-70B2026.01 | 8.65 | 3.42 | |
| PEARLBase Model=Qwen3-32B2026.01 | 7.78 | 2.35 | |
| PEARLBase Model=LLaMA2-70B2026.01 | 7.24 | 3.09 | |
| PEARLBase Model=Qwen3-14B2026.01 | 7.24 | 1.38 | |
| EAGLE3Base Model=LLaMA3.3-70B2026.01 | 6.51 | 4.56 | |
| OuroborosBase Model=Deepseek-33B2026.01 | 6.38 | 3.15 | |
| SpsBase Model=LLaMA2-70B2026.01 | 5.42 | 2.58 | |
| SpsBase Model=LLaMA3.3-70B2026.01 | 5.4 | 3.53 | |
| SpsBase Model=Deepseek-33B2026.01 | 5.09 | 2.15 | |
| OuroborosBase Model=LLaMA2-70B2026.01 | 5.08 | 2.08 | |
| SpsBase Model=Qwen3-32B2026.01 | 4.27 | 1.53 | |
| SpsBase Model=Qwen3-14B2026.01 | 3.37 | 1.26 | |
| EAGLE3Base Model=Qwen3-14B2026.01 | 2.99 | 1.91 | |
| TRBase Model=Deepseek-33B2026.01 | 2.83 | 2.14 | |
| EAGLE3Base Model=Qwen3-32B2026.01 | 2.83 | 2.27 | |
| TRBase Model=LLaMA2-70B2026.01 | 2.43 | 2.02 | |
| LookaheadBase Model=Deepseek-33B2026.01 | 2.34 | 1.75 | |
| PLDBase Model=Deepseek-33B2026.01 | 1.86 | 1.68 | |
| LookaheadBase Model=LLaMA2-70B2026.01 | 1.86 | 1.58 | |
| PLDBase Model=LLaMA3.3-70B2026.01 | 1.76 | 1.58 | |
| PLDBase Model=LLaMA2-70B2026.01 | 1.66 | 1.53 | |
| PLDBase Model=Qwen3-14B2026.01 | 1.52 | 1.38 | |
| PLDBase Model=Qwen3-32B2026.01 | 1.46 | 1.16 |