Code Generation on H_Eval
82.93AccuracyQwen3-30B-A3B
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen3-30B-A3BModel=Qwen3-30B-A3B, Target Top-K (K)=8, Avg. K=8.002026.05 | 82.93 | |
| BEAMModel=Qwen3-30B-A3B, Beta (β)=0.01, Avg. K=4.232026.05 | 81.71 | |
| BEAMModel=Qwen1.5-MoE-A2.7B, Beta (β)=0.01, Avg. K=1.562026.05 | 53.05 | |
| Qwen1.5-MoEModel=Qwen1.5-MoE-A2.7B, Target Top-K (K)=4, Avg. K=4.002026.05 | 50.61 | |
| BEAMModel=DeepSeekV2-Lite, Beta (β)=0.01, Avg. K=2.612026.05 | 46.95 | |
| DeepSeekV2-LiteModel=DeepSeekV2-Lite, Target Top-K (K)=6, Avg. K=6.002026.05 | 43.9 | |
| DynMoEModel=Qwen3-30B-A3B, Avg. K=61.662026.05 | 39.02 | |
| DynMoEModel=Qwen1.5-MoE-A2.7B, Avg. K=30.062026.05 | 31.1 | |
| DynMoEModel=DeepSeekV2-Lite, Avg. K=30.502026.05 | 0 |