Code Generation on MultiPL-E (pass@1 Lua, Julia, R)
42Pass@1 (Lua)DSC-6.7B-Ins-CF-X
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DSC-6.7B-Ins-CF-XModel Size=6.7B, Training=Agnostics (CF-X)2025.08 | 42 | 55 | 52 | |
| Phi4-mini-ins-CF-XTraining=Agnostics (CF-X)2025.08 | 41 | 43 | 35 | |
| Phi 4 mini insTraining=Instruction-tuned baseline2025.08 | 40 | 39 | 34 | |
| DSC 6.7B InsModel Size=6.7B, Training=Instruction-tuned baseline2025.08 | 40 | 54 | 37 | |
| SmolLM3-3B-CF-XModel Size=3B, Training=Agnostics (CF-X)2025.08 | 14 | 14 | 21 | |
| SmolLM3 3BModel Size=3B, Training=Baseline2025.08 | 11 | 12 | 18 |