Natural Language Understanding on GLUE (MNLI, SST-2, CoLA, QNLI, MRPC Subset)
86.33MNLI AccuracyFull
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FullBackbone=T5-Base2026.06 | 86.33 | 94.75 | 80.7 | 93.19 | 84.56 | 87.91 | |
| NA-LoRABackbone=T5-Base, mask-only=true2026.06 | 86.29 | 93.96 | 81.46 | 93.44 | 87.01 | 88.43 | |
| LoRA-ProBackbone=T5-Base2026.06 | 86.03 | 94.19 | 81.94 | 93.42 | 86.6 | 88.44 | |
| GoRABackbone=T5-Base2026.06 | 85.91 | 94.68 | 79.86 | 93.27 | 86.1 | 87.96 | |
| LoRA+Backbone=T5-Base2026.06 | 85.81 | 93.85 | 77.53 | 93.14 | 74.43 | 84.95 | |
| PiSSABackbone=T5-Base2026.06 | 85.75 | 94.07 | 74.27 | 93.15 | 76.31 | 84.71 | |
| rsLoRABackbone=T5-Base2026.06 | 85.73 | 94.19 | 72.32 | 93.12 | 52.86 | 79.64 | |
| LoRA-GABackbone=T5-Base2026.06 | 85.7 | 94.11 | 80.57 | 93.18 | 85.29 | 87.77 | |
| DoRABackbone=T5-Base2026.06 | 85.67 | 94.04 | 72.04 | 93.04 | 68.08 | 82.57 | |
| AdaLoRABackbone=T5-Base2026.06 | 85.45 | 93.69 | 69.16 | 91.66 | 68.14 | 81.62 | |
| LoRABackbone=T5-Base2026.06 | 85.3 | 94.04 | 69.35 | 92.96 | 68.38 | 82.08 |