Expert Assignment Recovery on Synthetic Routing Task (50 random seeds)
91.7Assignment AccuracyGrMoE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GrMoE2026.02 | 91.7 | 0.058 | 0 | 1.52 | |
| GrMoEAmortized=true2026.02 | 90.8 | 0.051 | 0 | 1.48 | |
| Soft MoE2026.02 | 86.8 | 0.095 | 8 | 1.55 | |
| vMF-Gate2026.02 | 86.3 | 0.178 | 18 | 1.38 | |
| Switch2026.02 | 85.1 | 0.187 | 22 | 1.41 | |
| Expert Choice2026.02 | 84.7 | 0.042 | 0 | 1.89 | |
| Softmax Top-12026.02 | 82.4 | 0.312 | 36 | 1.02 | |
| Hash2026.02 | 71.2 | 0.031 | 0 | 2.08 |