Code Generation on HumanEval+ (Score)
34.76ScoreARES-RL
Evaluation results
| Method | Links | |
|---|---|---|
| ARES-RLBackbone=Qwen3-32B2026.05 | 34.76 | |
| WebscaleBackbone=Qwen3-32B2026.05 | 33.54 | |
| NaturalReasoningBackbone=Qwen3-32B2026.05 | 32.93 | |
| CPTBackbone=Qwen3-32B2026.05 | 32.32 | |
| ARES-SFTBackbone=Qwen3-32B2026.05 | 31.1 | |
| Olmo3 BaseTuning Protocol=Freezing param.2026.07 | 20.1 | |
| LMK token tuningTuning Protocol=Freezing param.2026.07 | 19.5 | |
| Olmo3 512swaTuning Protocol=Full param. CPT2026.07 | 19.5 | |
| HiLS-Attn HoPE-Q-CalTuning Protocol=Full param. CPT2026.07 | 18.9 | |
| HiLS-Attn RoPE-Q-CalTuning Protocol=Full param. CPT2026.07 | 18.9 | |
| HiLS-Attn NoPE-Q-CalTuning Protocol=Full param. CPT2026.07 | 17.7 |