Code Generation on HE+ (pass@k)
76.71Pass@1EAFT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| EAFTBackbone=Qwen3-14B2026.07 | 76.71 | 91.4 | |
| GEMBackbone=Qwen3-14B2026.07 | 76.65 | 92.93 | |
| CEBackbone=Qwen3-14B2026.07 | 76.37 | 91.7 | |
| LP-SFTBackbone=Qwen3-14B2026.07 | 75.95 | 92.85 | |
| ASFTBackbone=Qwen3-14B2026.07 | 75.4 | 86.36 | |
| DFTBackbone=Qwen3-14B2026.07 | 73.38 | 78.2 | |
| LP-SFTBackbone=Qwen3-14B2026.07 | 72.13 | 90.16 | |
| ASFTBackbone=Qwen3-14B2026.07 | 71.25 | 81.79 | |
| EAFTBackbone=Qwen3-4B2026.07 | 68.93 | 88.84 | |
| LP-SFTBackbone=Qwen3-4B2026.07 | 68.35 | 89.05 | |
| ASFTBackbone=Qwen3-4B2026.07 | 67.01 | 84.31 | |
| CEBackbone=Qwen3-4B2026.07 | 66.95 | 87.65 | |
| GEMBackbone=Qwen3-4B2026.07 | 66.31 | 89.25 | |
| LP-SFTBackbone=Qwen3-4B2026.07 | 64.42 | 86.91 | |
| EAFTBackbone=Qwen3-14B2026.07 | 63.38 | 87.78 | |
| ASFTBackbone=Qwen3-4B2026.07 | 63.2 | 78.63 | |
| CEBackbone=Qwen3-14B2026.07 | 62.96 | 87.85 | |
| DFTBackbone=Qwen3-14B2026.07 | 61.92 | 67.37 | |
| DFTBackbone=Qwen3-4B2026.07 | 61.49 | 67.88 | |
| DFTBackbone=Qwen3-4B2026.07 | 60.52 | 64.21 | |
| EAFTBackbone=Qwen3-4B2026.07 | 59.76 | 84.38 | |
| CEBackbone=Qwen3-4B2026.07 | 58.11 | 84.57 | |
| GEMBackbone=Qwen3-14B2026.07 | 57.07 | 87.06 | |
| GEMBackbone=Qwen3-4B2026.07 | 54.48 | 85.34 | |
| EAFTBackbone=Llama3.1-8B2026.07 | 34.15 | 59.5 | |
| GEMBackbone=Llama3.1-8B2026.07 | 32.44 | 62.84 | |
| CEBackbone=Llama3.1-8B2026.07 | 32.32 | 59.12 | |
| ASFTBackbone=Llama3.1-8B2026.07 | 30.5 | 51.07 | |
| LP-SFTBackbone=Llama3.1-8B2026.07 | 30.18 | 59.6 | |
| LP-SFTBackbone=Llama3.1-8B2026.07 | 27.77 | 60.76 | |
| DFTBackbone=Llama3.1-8B2026.07 | 25.27 | 32.18 | |
| CEBackbone=Llama3.1-8B2026.07 | 24.09 | 58.85 | |
| EAFTBackbone=Llama3.1-8B2026.07 | 22.96 | 57.43 | |
| ASFTBackbone=Llama3.1-8B2026.07 | 21.9 | 47.5 | |
| GEMBackbone=Llama3.1-8B2026.07 | 20.4 | 52.43 | |
| DFTBackbone=Llama3.1-8B2026.07 | 8.41 | 15.89 |