Natural Language Understanding on GLUE (test) (Subset Tasks)
92.6STS-B ScoreLoRA-oBAR
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LoRA-oBARBackbone=RoBERTa (355M), # para=0.8M2024.10 | 92.6 | 88.7 | 90.3 | 65.1 | 91.6 | 85.7 | |
| LoRA-nBARBackbone=RoBERTa (355M), # para=0.8M2024.10 | 92.6 | 89.2 | 90.3 | 65.6 | 91.6 | 85.9 | |
| FTBackbone=RoBERTa (355M), # para=355M2024.10 | 92.4 | 86.6 | 90.9 | 68 | 90.2 | 85.6 | |
| LoRABackbone=RoBERTa (355M), # para=0.8M2024.10 | 92.4 | 88.2 | 89.6 | 64.8 | 91.4 | 85.3 | |
| AdapterBackbone=RoBERTa (355M), # para=0.8M2024.10 | 91.9 | 80.1 | 89.7 | 67.8 | 91.7 | 84.2 |