Natural Language Understanding on GLUE (val) (CoLA, SST-2, MRPC, STS-B, QNLI, RTE)
60.8CoLA ScoreVeRA (r=1024)
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VeRA (r=1024)Model=RoBERTa-base, # Params=43K2026.05 | 60.8 | 94 | 87.5 | 90.2 | 91.9 | 76.2 | 83.4 | |
| FFModel=RoBERTa-base, # Params=124M2026.05 | 60.6 | 94.3 | 87.8 | 90.5 | 92.2 | 77.3 | 83.8 | |
| GPartModel=RoBERTa-base, # Params=23K2026.05 | 60.6 | 94.3 | 88.5 | 90.4 | 91.1 | 77.3 | 83.7 | |
| LoRA (r=8)Model=RoBERTa-base, # Params=294K2026.05 | 60.5 | 94 | 87.8 | 90.8 | 92.8 | 75.4 | 83.5 | |
| BitFitModel=RoBERTa-base, # Params=102K2026.05 | 58.5 | 93.6 | 88 | 90.2 | 91.8 | 78.7 | 83.5 | |
| Uni-LoRAModel=RoBERTa-base, # Params=23K2026.05 | 58.1 | 94.2 | 86.5 | 90.3 | 92 | 76.9 | 83 | |
| LPModel=RoBERTa-base, # Params=02026.05 | 43.1 | 84.3 | 72.5 | 66.3 | 70.6 | 59.2 | 66 |