Natural Language Understanding on GLUE (MNLI, QNLI, QQP, SST2, COLA, STSB)
87.67MNLIFull
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| FullBackbone=RoBERTa-base, Training budget=Full2026.02 | 87.67 | 92.82 | 91.1 | 94.44 | 62 | 90.51 | |
| Scaled PSI-LoRABackbone=RoBERTa-base, Training budget=Full2026.02 | 86.57 | 92.18 | 89.1 | 94.15 | 61.41 | 90.83 | |
| SVDLoRABackbone=RoBERTa-base, Training budget=Full2026.02 | 86.4 | 92.13 | 88.68 | 94.09 | 63.35 | 91 | |
| LoRABackbone=RoBERTa-base, Training budget=Full2026.02 | 86.39 | 91.7 | 88.57 | 93.75 | 61.86 | 90.56 | |
| RPLoRABackbone=RoBERTa-base, Training budget=Full2026.02 | 85.67 | 84.64 | 87.06 | 93.58 | 58.74 | 80.58 | |
| Proj. PSI-LORABackbone=RoBERTa-base, Training budget=Full2026.02 | 84.91 | 90.46 | 86.96 | 93.35 | 59.29 | 89.93 |