Code Generation on HumanEval (pass@10, Avg.)
76.83pass@10ESFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ESFTBackbone=Qwen1.5-MoE, Params. (%)=15.912026.07 | 76.83 | 58.98 | |
| EPnGBackbone=Qwen1.5-MoE, Params. (%)=0.552026.07 | 74.39 | 58.98 | |
| LoRA (static)Backbone=Qwen1.5-MoE, Params. (%)=0.552026.07 | 70.12 | 57.6 |