Code Generation on LiveCodeBench (out-of-distribution)
66AccuracyHINT TUNING
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HINT TUNINGBackbone=DS-R1-32B2026.05 | 66 | 13 | |
| SFT-S1.1Backbone=DS-R1-32B2026.05 | 65.7 | 11.8 | |
| OriginalBackbone=Qwen3-4B2026.05 | 62.7 | 17.4 | |
| HINT TUNINGBackbone=Qwen3-4B2026.05 | 61.9 | 13.2 | |
| SFT-S1.1Backbone=DS-R1-14B2026.05 | 57.1 | 12.1 | |
| OriginalBackbone=DS-R1-32B2026.05 | 56.7 | 11.1 | |
| HINT TUNINGBackbone=DS-R1-14B2026.05 | 53.7 | 13.8 | |
| SFT-S1.1Backbone=Qwen3-4B2026.05 | 50.4 | 14.7 | |
| OriginalBackbone=DS-R1-14B2026.05 | 49.3 | 10.8 | |
| SFT-S1.1Backbone=DS-R1-7B2026.05 | 39.2 | 15 | |
| HINT TUNINGBackbone=DS-R1-7B2026.05 | 37.7 | 16.6 | |
| OriginalBackbone=DS-R1-7B2026.05 | 37.3 | 11.8 |