ResearchBenchmarksCode Generation on HumanEval problems 80–163 (held-out)Code Generation on HumanEval problems 80–163 (held-out)Follow70.3Pass@1S040.76448.43256.163.768Apr 1, 2026Evaluation resultsMethodMethodLinksPass@1Pass@5Pass@10S0Parameters=12.6M, Numb...Parameters=12.6M, Number of seeds=32026.0470.384.588.5LoRArank=24, Parameters=4....rank=24, Parameters=4.7M, Number of seeds=32026.0456.364.166.7BaselineNumber of seeds=3Number of seeds=32026.0441.964.269.4