Natural Language Understanding on GLUE (SST2, WSC, RTE Subset)
94.4SST-2 AccuracySplitLoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| SplitLoRAModel=LLaMA-3.2 (1B)2026.03 | 94.4 | 61.5 | 70 | |
| HO-SFLModel=LLaMA-3.2 (1B)2026.03 | 93.9 | 61.5 | 73.3 | |
| HO-SFLModel=Gemma-3 (270M)2026.03 | 90.8 | 62.5 | 65 | |
| SplitLoRAModel=Gemma-3 (270M)2026.03 | 90.3 | 61.5 | 59.6 | |
| HO-SFLModel=OPT (125M)2026.03 | 87.6 | 60.6 | 59.2 | |
| SplitLoRAModel=OPT (125M)2026.03 | 87.5 | 64.4 | 57.8 | |
| ZO-SFLModel=LLaMA-3.2 (1B)2026.03 | 61.5 | 36.5 | 49.1 | |
| ZO-SFLModel=OPT (125M)2026.03 | 52.8 | 36.5 | 52 | |
| ZO-SFLModel=Gemma-3 (270M)2026.03 | 51.8 | 36.5 | 54.2 |