Code Generation on BigCodeBench (tau, Speedup)
4.18tauEDA (Ours)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| EDA (Ours)Temperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 4.18 | 2.67 | |
| EDA (Ours)Temperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.95 | 2.06 | |
| EDA (Base)Temperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 3.68 | 2.4 | |
| Full-FTTemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 3.66 | 2.38 | |
| LoRATemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 3.6 | 2.35 | |
| Full-FTTemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.35 | 1.8 | |
| EDA (Base)Temperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.33 | 1.79 | |
| LoRATemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 3.3 | 1.78 | |
| Training-FreeTemperature=0, Target Model=Qwen2.5-Coder-7B2026.03 | 1.74 | 1.24 | |
| Training-FreeTemperature=1, Target Model=Qwen2.5-Coder-7B2026.03 | 1.22 | 0.75 |