MoE Compression Efficiency on MoE Model 8-64 experts, d=512, d_ff=2048
150Compression Ratio (64)ButterflyMoE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ButterflyMoE2026.01 | 150 | — | — | |
| MoQEquantization=2-bit2026.01 | 5 | — | — | |
| MC2026.01 | 4 | — | — | |
| PuzzleMoE2026.01 | 2 | — | — | |
| Standard MoE2026.01 | 1 | — | — |