List your company
ResearchFormerly WizWand

Code Generation on HE+ (pass@k)

76.71Pass@1EAFT
5.67824.11942.5661.001Jul 6, 2026
Updated 3mo ago

Evaluation results

MethodLinks
EAFTBackbone=Qwen3-14B2026.0776.7191.4
GEMBackbone=Qwen3-14B2026.0776.6592.93
CEBackbone=Qwen3-14B2026.0776.3791.7
LP-SFTBackbone=Qwen3-14B2026.0775.9592.85
ASFTBackbone=Qwen3-14B2026.0775.486.36
DFTBackbone=Qwen3-14B2026.0773.3878.2
LP-SFTBackbone=Qwen3-14B2026.0772.1390.16
ASFTBackbone=Qwen3-14B2026.0771.2581.79
EAFTBackbone=Qwen3-4B2026.0768.9388.84
LP-SFTBackbone=Qwen3-4B2026.0768.3589.05
ASFTBackbone=Qwen3-4B2026.0767.0184.31
CEBackbone=Qwen3-4B2026.0766.9587.65
GEMBackbone=Qwen3-4B2026.0766.3189.25
LP-SFTBackbone=Qwen3-4B2026.0764.4286.91
EAFTBackbone=Qwen3-14B2026.0763.3887.78
ASFTBackbone=Qwen3-4B2026.0763.278.63
CEBackbone=Qwen3-14B2026.0762.9687.85
DFTBackbone=Qwen3-14B2026.0761.9267.37
DFTBackbone=Qwen3-4B2026.0761.4967.88
DFTBackbone=Qwen3-4B2026.0760.5264.21
EAFTBackbone=Qwen3-4B2026.0759.7684.38
CEBackbone=Qwen3-4B2026.0758.1184.57
GEMBackbone=Qwen3-14B2026.0757.0787.06
GEMBackbone=Qwen3-4B2026.0754.4885.34
EAFTBackbone=Llama3.1-8B2026.0734.1559.5
GEMBackbone=Llama3.1-8B2026.0732.4462.84
CEBackbone=Llama3.1-8B2026.0732.3259.12
ASFTBackbone=Llama3.1-8B2026.0730.551.07
LP-SFTBackbone=Llama3.1-8B2026.0730.1859.6
LP-SFTBackbone=Llama3.1-8B2026.0727.7760.76
DFTBackbone=Llama3.1-8B2026.0725.2732.18
CEBackbone=Llama3.1-8B2026.0724.0958.85
EAFTBackbone=Llama3.1-8B2026.0722.9657.43
ASFTBackbone=Llama3.1-8B2026.0721.947.5
GEMBackbone=Llama3.1-8B2026.0720.452.43
DFTBackbone=Llama3.1-8B2026.078.4115.89