Natural Language Understanding on GLUE (SST-2, STS-B, MRPC, RTE Subset)
81.2RTE AccuracyNexus
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| NexusModel(s)=Llama-3-8B, Security Scope=Full (HE)2026.03 | 81.2 | 94.5 | — | — | — | — | |
| IronModel(s)=BERT, Security Scope=Full (HE+MPC)2026.03 | 70.8 | 92.8 | 89.4 | 89.9 | 60 | 280.99 | |
| NexusModel(s)=BERT, Security Scope=Full (HE)2026.03 | 69.9 | 92.1 | — | — | 37.3 | 164 | |
| PowerFormerModel(s)=BERT, Security Scope=Full (HE)2026.03 | 69.8 | 92 | — | 87.8 | 20 | — | |
| BaselineModel(s)=BERT, Security Scope=None2026.03 | 69.7 | 92.3 | 89.1 | 90.3 | 1 | — | |
| BOLTModel(s)=BERT, Security Scope=Full (HE+MPC)2026.03 | 69.3 | 92.8 | 88.4 | 90 | 60 | 25.74 | |
| SecFormerModel(s)=BERT, Security Scope=Full (HE+MPC)2026.03 | 69 | — | 87.4 | 89.2 | 19 | — | |
| NimbusModel(s)=BERT, Security Scope=Full (HE+MPC)2026.03 | 66.8 | 92.6 | 87.9 | 89.8 | 20 | 2 | |
| MPCFormerModel(s)=BERT, Security Scope=Full (MPC)2026.03 | 64.9 | — | 80.3 | 88.7 | 18 | 68.6 | |
| HELIX (In-dist Mapper, no FT)Model(s)=Model Pairs*, Security Scope=Linear (HE)2026.03 | 61 | 92.8 | 75.6 | 80.2 | 1 | 1 | |
| HELIX (IMDB Mapper, no FT)Model(s)=Model Pairs*, Security Scope=Linear (HE)2026.03 | 59.6 | 92.3 | 61 | 77.8 | 1 | 1 | |
| Enc.-Friendly Arch.Model(s)=BERT, Security Scope=Full (HE)2026.03 | 59.3 | 81.9 | 80 | 81.5 | 26.5 | — | |
| HELIX (Fine-Tuned)Model(s)=Llama-2-8b, Security Scope=Linear (HE)2026.03 | 55.6 | 93 | 80.6 | 82 | 1 | 1 |