Code Generation on MBPP (accuracy (CC→MBPP))
86.9Accuracy (CC→MBPP)iCLP
Evaluation results
| Method | Links | |
|---|---|---|
| iCLPModel Size=7B2025.12 | 86.9 | |
| FT-SModel Size=7B2025.12 | 78.9 | |
| GRPOModel Size=7B2025.12 | 76 | |
| FT-EModel Size=7B2025.12 | 75.6 | |
| BaseModel Size=7B2025.12 | 74.9 | |
| iCLPModel Size=3B2025.12 | 73 | |
| FT-SModel Size=3B2025.12 | 65.2 | |
| FT-LEModel Size=3B2025.12 | 62 | |
| FT-EModel Size=3B2025.12 | 61.2 | |
| BaseModel Size=3B2025.12 | 57.1 | |
| iCLPModel Size=0.5B2025.12 | 51 | |
| FT-SModel Size=0.5B2025.12 | 47 | |
| FT-EModel Size=0.5B2025.12 | 43.6 | |
| BaseModel Size=0.5B2025.12 | 39.3 | |
| FT-LEModel Size=0.5B2025.12 | 21.4 |