Private Inference on MoE-Small
2.04Runtime (min)SecMoE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SecMoENetwork Setting=LAN, Number of Experts=322026.01 | 2.04 | 0.84 | |
| SecMoENetwork Setting=LAN, Number of Experts=642026.01 | 2.23 | 0.81 | |
| SecMoENetwork Setting=LAN, Number of Experts=1282026.01 | 2.52 | 0.82 | |
| SecMoENetwork Setting=WAN, Number of Experts=322026.01 | 3.04 | — | |
| SecMoENetwork Setting=WAN, Number of Experts=642026.01 | 3.47 | — | |
| BumbleBeeNetwork Setting=LAN, Number of Experts=322026.01 | 3.51 | 2.04 | |
| SecMoENetwork Setting=WAN, Number of Experts=1282026.01 | 3.68 | — | |
| BumbleBeeNetwork Setting=WAN, Number of Experts=322026.01 | 4.24 | — | |
| IronNetwork Setting=LAN, Number of Experts=322026.01 | 4.35 | 9.44 | |
| BumbleBeeNetwork Setting=LAN, Number of Experts=642026.01 | 6.51 | 3.37 | |
| IronNetwork Setting=LAN, Number of Experts=642026.01 | 7.58 | 17.19 | |
| BumbleBeeNetwork Setting=WAN, Number of Experts=642026.01 | 7.59 | — | |
| BumbleBeeNetwork Setting=LAN, Number of Experts=1282026.01 | 9.76 | 5.81 | |
| IronNetwork Setting=LAN, Number of Experts=1282026.01 | 12.07 | 24.17 | |
| BumbleBeeNetwork Setting=WAN, Number of Experts=1282026.01 | 13.88 | — | |
| IronNetwork Setting=WAN, Number of Experts=322026.01 | 17.4 | — | |
| IronNetwork Setting=WAN, Number of Experts=642026.01 | 35.19 | — | |
| IronNetwork Setting=WAN, Number of Experts=1282026.01 | 59.14 | — | |
| BumbleBeeNetwork Setting=LAN, Number of Experts=162026.01 | — | 1.42 | |
| IronNetwork Setting=LAN, Number of Experts=162026.01 | — | 7.13 | |
| SecMoENetwork Setting=LAN, Number of Experts=162026.01 | — | 0.81 |