Code Generation on CodeContests (evaluation set)
19.7Pass@1Sequence-level adapter
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Sequence-level adapterSetting=mix CoT, Budget=w/ budget2026.03 | 19.7 | 32.5 | |
| Sequence-level adapterSetting=mix CoT, Budget=w/o budget2026.03 | 17.06 | 29.9 | |
| Static sampling (Mixed)Setting=mix CoT2026.03 | 14.8 | 25.63 | |
| Sequence-level adapterSetting=w/o CoT, Budget=w/o budget2026.03 | 14.53 | 26.08 | |
| Sequence-level adapterSetting=w/o CoT, Budget=w/ budget2026.03 | 14.5 | 23.1 | |
| Static sampling (Best)Setting=mix CoT2026.03 | 13.97 | 29.1 | |
| Static sampling (Best)Setting=w/o CoT2026.03 | 11.43 | 22.8 | |
| Static sampling (Mixed)Setting=w/o CoT2026.03 | 10.53 | 22.23 |