Privacy-Preserving Inference on BERT Base (inference)
18.591Total Time (s)MPCFormer
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| MPCFormerModel=BERT-Base2024.01 | 18.591 | 0.351 | 0.604 | 3.129 | 1.895 | 6.522 | 0.497 | 8.589 | 3.463 | — | |
| SecFormerModel=BERT-Base2024.01 | 19.513 | 8.132 | 17.817 | 1.362 | 1.844 | 1.523 | 0.468 | 8.496 | 3.463 | — | |
| FEnc2Module=O = A × V2026.06 | 26.34 | — | — | — | — | — | — | — | — | 1.23 | |
| OrionModule=O = A × V2026.06 | 32.39 | — | — | — | — | — | — | — | — | — | |
| FEnc2Module=X × WQ,K,V2026.06 | 43.35 | — | — | — | — | — | — | — | — | 2.03 | |
| PUMAModel=BERT-Base2024.01 | 69.661 | 16.343 | 28.689 | 42.219 | 67.837 | 2.285 | 0.477 | 8.781 | 3.463 | — | |
| CrypTenModel=BERT-Base2024.01 | 71.097 | 16.46 | 28.689 | 37.25 | 50.281 | 6.614 | 0.492 | 9.365 | 3.463 | — | |
| OrionModule=X × WQ,K,V2026.06 | 87.85 | — | — | — | — | — | — | — | — | — | |
| FEnc2Module=FFN2026.06 | 115.82 | — | — | — | — | — | — | — | — | 2.01 | |
| FEnc2Module=A = Q × K⊺2026.06 | 124.96 | — | — | — | — | — | — | — | — | 13.91 | |
| OrionModule=FFN2026.06 | 232.71 | — | — | — | — | — | — | — | — | — | |
| FEnc2Module=MatMul latency/Encoder Block2026.06 | 310.48 | — | — | — | — | — | — | — | — | 6.74 | |
| OrionModule=A = Q × K⊺2026.06 | 1,738.17 | — | — | — | — | — | — | — | — | — | |
| OrionModule=MatMul latency/Encoder Block2026.06 | 2,091.12 | — | — | — | — | — | — | — | — | — |