Large Language Model Evaluation on OpenCompass
84.88cMMLUQwen3-30B-A3B
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-30B-A3BTop-K=8, QPS=16, TPOT (ms. ↓)=44.42026.02 | 84.88 | 90.21 | 76.7 | 72.28 | 89.23 | 79.05 | 87.2 | 78.4 | 82.24 | |
| SERETop-K=2, Threshold ρ=0.5, QPS=16, TPOT (ms. ↓)=32.822026.02 | 81.51 | 90.37 | 74.15 | 72.06 | 85.97 | 81.55 | 85.37 | 72 | 80.37 | |
| LYNXTop-K=2, QPS=16, TPOT (ms. ↓)=38.212026.02 | 81.36 | 90.12 | 72.27 | 69.1 | 80.44 | 76.81 | 84.15 | 73.4 | 78.46 | |
| SERETop-K=2, Threshold ρ=0, QPS=16, TPOT (ms. ↓)=32.122026.02 | 81.24 | 89.79 | 71.33 | 70.22 | 82.41 | 80.8 | 82.93 | 63.8 | 77.82 | |
| SERETop-K=1, Threshold ρ=0.5, QPS=16, TPOT (ms. ↓)=33.12026.02 | 77.89 | 89.76 | 65.45 | 53.4 | 54.28 | 54.86 | 64.02 | 53.2 | 64.11 | |
| LYNXTop-K=1, QPS=16, TPOT (ms. ↓)=33.382026.02 | 70.76 | 88.26 | 59.08 | 44.28 | 48.37 | 47.88 | 55.49 | 46 | 57.52 | |
| SERETop-K=1, Threshold ρ=0, QPS=16, TPOT (ms. ↓)=28.042026.02 | 60.53 | 85.08 | 57.64 | 46.98 | 52.08 | 52.12 | 32.32 | 31.4 | 52.27 | |
| HC-SMoENumber of experts=80, QPS=16, TPOT (ms. ↓)=39.142026.02 | 45.62 | 83.94 | 65.11 | 59.86 | 79.23 | 64.84 | 86.59 | 70.2 | 69.42 | |
| HC-SMoENumber of experts=48, QPS=16, TPOT (ms. ↓)=33.452026.02 | 32.78 | 64.53 | 51.66 | 34.36 | 40.79 | 54.86 | 49.39 | 44.2 | 46.57 | |
| Qwen3-30B-A3BTop-K=2, QPS=16, TPOT (ms. ↓)=30.972026.02 | 10.01 | 60.52 | 10.48 | 3.38 | 6.97 | 16.96 | 3.66 | 2.4 | 14.3 | |
| Qwen3-30B-A3BTop-K=1, QPS=16, TPOT (ms. ↓)=27.282026.02 | 0 | 61.68 | 4.89 | 0.08 | 0.91 | 1.25 | 0 | 0 | 8.6 |