Code Generation on MBPP (Accuracy, Throughput)
75.87AccuracyQwen2.5 7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen2.5 7BGeneration mode=Autoregressive2026.06 | 75.87 | 47.09 | |
| PoE-BridgeImportance sampling=true2026.06 | 73.2 | 72.1 | |
| PoE-BridgeImportance sampling=false2026.06 | 72.2 | 79.65 | |
| Dream 7BSampling strategy=Entropy, Tokens per step=22026.06 | 55.93 | 8.26 | |
| Dream 7BSampling strategy=Entropy, Tokens per step=42026.06 | 49.13 | 15.37 | |
| Dream 7BSampling strategy=Random, Tokens per step=22026.06 | 34 | 5.5 |