Code Generation on MBPP (P@1, Spd, τ)
2.3SpeedMoE-Spec
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| MoE-SpecModel=Mixtral-8x7B, Temperature=02026.02 | 2.3 | 45 | 3.1 | |
| EAGLE-3Model=OLMoE-1B-7B, Temperature=02026.02 | 2.2 | 45 | 4 | |
| MoE-SpecModel=OLMoE-1B-7B, Temperature=02026.02 | 2.2 | 46 | 3.8 | |
| EAGLE-3Model=OLMoE-1B-7B, Temperature=12026.02 | 2 | 40 | 3.5 | |
| MoE-SpecModel=OLMoE-1B-7B, Temperature=12026.02 | 2 | 42 | 3.5 | |
| MoE-SpecModel=Mixtral-8x7B, Temperature=12026.02 | 1.8 | 50 | 3.1 | |
| EAGLEModel=Mixtral-8x7B, Temperature=02026.02 | 1.7 | 45 | 3.2 | |
| EAGLE-3Model=Qwen3-30B-A3B, Temperature=02026.02 | 1.7 | 89 | 2.9 | |
| MoE-SpecModel=Qwen3-30B-A3B, Temperature=02026.02 | 1.7 | 89 | 2.9 | |
| EAGLE-3Model=Qwen3-30B-A3B, Temperature=12026.02 | 1.7 | 89 | 2.9 | |
| MoE-SpecModel=Qwen3-30B-A3B, Temperature=12026.02 | 1.7 | 89 | 2.9 | |
| EAGLEModel=Mixtral-8x7B, Temperature=12026.02 | 1.6 | 48 | 3.1 | |
| ARModel=Mixtral-8x7B, Temperature=02026.02 | 1 | 56 | — | |
| ARModel=OLMoE-1B-7B, Temperature=02026.02 | 1 | 45 | — | |
| ARModel=Qwen3-30B-A3B, Temperature=02026.02 | 1 | 90 | — | |
| ARModel=Mixtral-8x7B, Temperature=12026.02 | 1 | 57 | — | |
| ARModel=OLMoE-1B-7B, Temperature=12026.02 | 1 | 41 | — | |
| ARModel=Qwen3-30B-A3B, Temperature=12026.02 | 1 | 88 | — |