Code Generation on HumanEval+ (tau, Speedup)
1.41tauTraining-Free
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Training-FreeTemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 1.41 | 0.85 | |
| Training-FreeTemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 1.74 | 1.08 | |
| LoRATemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.8 | 2 | |
| EDA (Base)Temperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.86 | 2.04 | |
| Full-FTTemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.88 | 2.05 | |
| EDA (Ours)Temperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 4.55 | 2.32 | |
| LoRATemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 4.62 | 2.58 | |
| Full-FTTemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 4.7 | 2.62 | |
| EDA (Base)Temperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 4.72 | 2.63 | |
| EDA (Ours)Temperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 5.31 | 2.98 |