Code Generation on CodeContests (accuracy (CC))
26.7Accuracy (CC)iCLP
Evaluation results
| Method | Links | |
|---|---|---|
| iCLPModel Size=7B2025.12 | 26.7 | |
| FT-SModel Size=7B2025.12 | 22.4 | |
| FT-EModel Size=7B2025.12 | 19.4 | |
| GRPOModel Size=7B2025.12 | 19.2 | |
| iCLPModel Size=3B2025.12 | 18.8 | |
| BaseModel Size=7B2025.12 | 15.8 | |
| FT-SModel Size=3B2025.12 | 13.9 | |
| FT-LEModel Size=3B2025.12 | 12.1 | |
| iCLPModel Size=0.5B2025.12 | 11.5 | |
| FT-EModel Size=3B2025.12 | 10.9 | |
| BaseModel Size=3B2025.12 | 9 | |
| FT-SModel Size=0.5B2025.12 | 8.5 | |
| FT-EModel Size=0.5B2025.12 | 5.5 | |
| FT-LEModel Size=0.5B2025.12 | 1.8 | |
| BaseModel Size=0.5B2025.12 | 1.2 |