Secure Transformer Inference on GLUE (test)
45.28CoLA Inference Time (s)SecDTD
Evaluation Results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SecDTDNetwork Environment=LAN, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 45.28 | 2.14 | 65.24 | 3.21 | 62.47 | 3.35 | 66.02 | 3.17 | 90.38 | 2.32 | 65.92 | 3.18 | 117.04 | 4.19 | 145.21 | 3.38 | |
| BaselineNetwork Environment=LAN, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 96.79 | — | 209.33 | — | 209.33 | — | 209.33 | — | 209.33 | — | 209.33 | — | 490.86 | — | 490.86 | — | |
| SecDTDNetwork Environment=WAN, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 347.24 | 1.86 | 466.35 | 2.71 | 444.88 | 2.84 | 462.7 | 2.73 | 610.95 | 2.06 | 481.42 | 2.62 | 751.82 | 3.93 | 906.58 | 3.26 | |
| SecDTDNetwork Environment=MOBILE, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 588.67 | 1.95 | 807.89 | 2.88 | 772.39 | 3.01 | 807.59 | 2.88 | 1,080.94 | 2.15 | 826.98 | 2.82 | 1,351.27 | 4.14 | 1,647.08 | 3.39 | |
| BaselineNetwork Environment=WAN, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 645.85 | — | 1,261.57 | — | 1,261.57 | — | 1,261.57 | — | 1,261.57 | — | 1,261.57 | — | 2,957.89 | — | 2,957.89 | — | |
| BaselineNetwork Environment=MOBILE, Framework=BumbleBee, Fine-tuning Status=Without fine-tuning2026.03 | 1,150.3 | — | 2,328.31 | — | 2,328.31 | — | 2,328.31 | — | 2,328.31 | — | 2,328.31 | — | 5,591.46 | — | 5,591.46 | — |