Natural Language Understanding on GLUE (val) - Subset (CoLA, SST-2, MRPC, STS-B, QNLI, RTE)
66.3CoLA ScoreFF
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| FFModel=RoBERTa-large, # Params=355M2026.05 | 66.3 | 95.8 | 89.5 | 92 | 94.6 | 83.4 | 86.9 | |
| BitFitModel=RoBERTa-large, # Params=271K2026.05 | 65.4 | 95.9 | 87.8 | 89.9 | 94 | 82.3 | 85.9 | |
| LoRA (r=8)Model=RoBERTa-large, # Params=786K2026.05 | 65.3 | 95.6 | 88 | 91.3 | 94.8 | 85.4 | 86.7 | |
| Uni-LoRAModel=RoBERTa-large, # Params=23K2026.05 | 65 | 95.4 | 88.7 | 91.5 | 92.9 | 81.8 | 85.9 | |
| GPartModel=RoBERTa-large, # Params=23K2026.05 | 64.2 | 95.4 | 87.2 | 91.7 | 94 | 85.2 | 86.3 | |
| VeRA (r=256)Model=RoBERTa-large, # Params=61K2026.05 | 59.1 | 95.9 | 87.8 | 91 | 94.1 | 87.2 | 85.8 | |
| LPModel=RoBERTa-large, # Params=02026.05 | 44.9 | 86.8 | 72.3 | 58.8 | 66.8 | 58.8 | 64.7 |