Code Generation on Code R1 (pass@1)
19.96Pass@1DLLG
Evaluation results
| Method | Links | |
|---|---|---|
| DLLGModel scale=1.5B, Evaluation mode=0-shot2026.06 | 19.96 | |
| EmbedLLMModel scale=1.5B, Evaluation mode=0-shot2026.06 | 18.26 | |
| Entropy WeightingModel scale=1.5B, Evaluation mode=0-shot2026.06 | 18.26 | |
| Pack of LLMsModel scale=1.5B, Evaluation mode=0-shot2026.06 | 18.12 | |
| UniTeModel scale=1.5B, Evaluation mode=0-shot2026.06 | 18.12 | |
| Token Maj-VotingModel scale=1.5B, Evaluation mode=0-shot2026.06 | 17.56 | |
| GaCModel scale=1.5B, Evaluation mode=0-shot2026.06 | 16.71 | |
| Qwen2.5-Coder-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 15.31 | |
| Qwen2.5-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 15.03 | |
| LinearModel scale=1.5B, Evaluation mode=0-shot2026.06 | 13.76 | |
| RouterDCModel scale=1.5B, Evaluation mode=0-shot2026.06 | 13.62 | |
| SLERPModel scale=1.5B, Evaluation mode=0-shot2026.06 | 12.64 | |
| Task ArithmeticModel scale=1.5B, Evaluation mode=0-shot2026.06 | 12.36 | |
| Qwen2.5-Math-1.5B-InstructModel scale=1.5B, Evaluation mode=0-shot2026.06 | 4.63 |