Code Generation on CodeContests+
39.1LCBv6 ScoreMETIS
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| METISModel=DS-R1-Distill Llama-8B2026.05 | 39.1 | 79.9 | 66.2 | 13.8 | 49.8 | 12 | 37.5 | |
| No Curr.Model=DS-R1-Distill Llama-8B2026.05 | 38.9 | 78.6 | 64.6 | 14.6 | 49.2 | 19.2 | — | |
| PCLModel=DS-R1-Distill Llama-8B2026.05 | 38.3 | 76.8 | 67.4 | 14.4 | 49.2 | 14.7 | 23.4 | |
| SECModel=DS-R1-Distill Llama-8B2026.05 | 37.3 | 77.4 | 66.2 | 15.3 | 49.1 | 18.1 | 5.7 | |
| ADCLModel=DS-R1-Distill Llama-8B2026.05 | 37.2 | 75.6 | 67 | 13.5 | 48.3 | 31.8 | 65.6 | |
| PCLModel=Qwen3-8B Base2026.05 | 31.7 | 86.6 | 68 | 27.5 | 53.5 | 12.9 | 15.7 | |
| METISModel=Qwen3-8B Base2026.05 | 31.7 | 84.8 | 70 | 27.1 | 53.4 | 11.3 | 26.1 | |
| No Curr.Model=Qwen3-8B Base2026.05 | 31.6 | 84.1 | 68.4 | 27.6 | 52.9 | 15.3 | — | |
| SECModel=Qwen3-8B Base2026.05 | 31.1 | 84.1 | 67.6 | 28 | 52.7 | 13.1 | 14.4 | |
| ADCLModel=Qwen3-8B Base2026.05 | 30.7 | 83.6 | 69 | 27.2 | 52.6 | 22.7 | 48.4 | |
| METISModel=Llama-3.1 8B-Instruct2026.05 | 19.1 | 65.8 | 59 | 17.5 | 40.4 | 5.4 | 67.9 | |
| PCLModel=Llama-3.1 8B-Instruct2026.05 | 18.4 | 64 | 57.8 | 18.6 | 39.7 | 5.3 | 68.5 | |
| ADCLModel=Llama-3.1 8B-Instruct2026.05 | 17.5 | 60.9 | 58.2 | 17.9 | 38.6 | 19.1 | 13.7 | |
| No Curr.Model=Llama-3.1 8B-Instruct2026.05 | 17.2 | 60.7 | 58 | 19.2 | 38.8 | 16.8 | — | |
| SECModel=Llama-3.1 8B-Instruct2026.05 | 15.4 | 65.8 | 58.4 | 20.5 | 40 | 15.7 | 6.5 |