Code Generation on MBPP (Accepted length (τ))
5.26Accepted Length (τ)DSpark
Evaluation results
| Method | Links | |
|---|---|---|
| DSparktarget_model=Qwen3-14B2026.07 | 5.26 | |
| DSparktarget_model=Qwen3-8B2026.07 | 5.16 | |
| DSparktarget_model=Qwen3-4B2026.07 | 5.13 | |
| DSparktarget_model=Gemma4-12B2026.07 | 5.11 | |
| Eagle3target_model=Gemma4-12B2026.07 | 4.72 | |
| DFlashtarget_model=Qwen3-14B2026.07 | 4.44 | |
| DFlashtarget_model=Qwen3-4B2026.07 | 4.4 | |
| DFlashtarget_model=Gemma4-12B2026.07 | 4.39 | |
| DFlashtarget_model=Qwen3-8B2026.07 | 4.36 | |
| Eagle3target_model=Qwen3-8B2026.07 | 3.96 | |
| Eagle3target_model=Qwen3-14B2026.07 | 3.81 | |
| Eagle3target_model=Qwen3-4B2026.07 | 3.69 |