Code on MBPP 1,000-example (test)
9.0212PerplexityQwen3-VL-2B-Instruct
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3-VL-2B-InstructAblation State=SRA, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 9.0212 | -0.2403 | |
| Qwen3-VL-2B-InstructAblation State=Base, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 9.2615 | — | |
| Ministral-14B-Instruct-2512Ablation State=SRA, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 11.1405 | -0.3506 | |
| Ministral-14B-Instruct-2512Ablation State=Base, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 11.4911 | — | |
| Qwen3-VL-8B-InstructAblation State=SRA, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 11.8694 | -0.2965 | |
| Qwen3-VL-8B-InstructAblation State=Base, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 12.1659 | — | |
| Qwen3-VL-4B-InstructAblation State=SRA, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 13.5447 | -0.2597 | |
| Qwen3-VL-4B-InstructAblation State=Base, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 13.8044 | — | |
| Ministral-3B-Instruct-2512Ablation State=SRA, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 20.3751 | -1.0791 | |
| Ministral-3B-Instruct-2512Ablation State=Base, Evaluation Mode=Teacher-forced, Sequence Length=Full-sequence, Seed=422026.01 | 21.4542 | — |