Routing Interpretability on preference-700K (test)
0.38Description FidelitySparse MoE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Sparse MoE2026.06 | 0.38 | 15.13 | |
| Vanilla MoE2026.06 | 0.29 | 0.09 | |
| MiCRo2026.06 | 0.15 | 0.04 | |
| Random2026.06 | 0.01 | -0.04 |
| Method | Links | ||
|---|---|---|---|
| Sparse MoE2026.06 | 0.38 | 15.13 | |
| Vanilla MoE2026.06 | 0.29 | 0.09 | |
| MiCRo2026.06 | 0.15 | 0.04 | |
| Random2026.06 | 0.01 | -0.04 |