Code Generation on HumanEval (E, d, Acc. Rate, Speedup)
2.18SpeedupLEDE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LEDEModel=CodeLLaMA-7B2026.06 | 2.18 | 8.35 | 5.93 | 74.8 | |
| LEDEModel=CodeLLaMA-34B2026.06 | 2.07 | 14.57 | 4.41 | 86.4 | |
| DVModel=CodeLLaMA-7B2026.06 | 2.02 | 8 | 5.9 | 79 | |
| LSModel=CodeLLaMA-7B2026.06 | 1.94 | 7 | 6 | 64.5 | |
| DVModel=CodeLLaMA-34B2026.06 | 1.88 | 12 | 5.57 | 76.5 | |
| LSModel=CodeLLaMA-34B2026.06 | 1.61 | 6 | 12 | 27.2 | |
| LITEModel=CodeLLaMA-7B2026.06 | 1.3 | 20.24 | 11.72 | 83.8 | |
| LITEModel=CodeLLaMA-34B2026.06 | 1.25 | 30.79 | 11.47 | 82.6 | |
| ARModel=CodeLLaMA-7B2026.06 | 1 | — | — | — | |
| ARModel=CodeLLaMA-34B2026.06 | 1 | — | — | — |