Code Synthesis on MultiPL-E (Lua, Julia, R)
68Success Rate (Lua)Qwen3-8B-CF-X
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen3-8B-CF-X2025.08 | 68 | 61 | 52 | |
| Qwen3-4B-CF-X2025.08 | 64 | 54 | 43 | |
| Qwen 3 8B2025.08 | 63 | 53 | 44 | |
| Qwen 3 4B2025.08 | 61 | 51 | 36 | |
| Qwen3-4B-MBPP-X2025.08 | 51 | 62 | 41 |