Natural Language Understanding on GLUE (8-Task Subset: CoLA, MNLI, MRPC, QNLI, QQP, RTE, STS-B, SST-2)
90.65MNLI AccuracyLoRA
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| LoRAr=8, #Params=1.33M, Backbone=DeBERTaV3_base2025.05 | 90.65 | 94.95 | 89.95 | 69.82 | 93.87 | 91.99 | 85.2 | 91.6 | 88.5 | |
| BOFTb=8, m=2, #Params=0.75M, Backbone=DeBERTaV3_base2025.05 | 90.25 | 96.44 | 92.4 | 72.95 | 92.1 | 94.23 | 88.81 | 91.92 | 89.89 | |
| PiCar=16, #Params=0.11M, Backbone=DeBERTaV3_base2025.05 | 90.2 | 96 | 91.4 | 73.1 | 91.6 | 94.2 | 89.2 | 91.8 | 89.69 | |
| LoRAr=1, #Params=0.17M, Backbone=DeBERTaV3_base2025.05 | 90.12 | 95.64 | 86.43 | 69.13 | 91.43 | 94.18 | 87.36 | 91.52 | 88.23 | |
| SVFT-Rd=2, #Params=0.28M, Backbone=DeBERTaV3_base2025.05 | 89.97 | 95.99 | 88.99 | 72.61 | 91.5 | 93.9 | 88.09 | 91.73 | 89.1 | |
| VeRAr=1024, #Params=0.09M, Backbone=DeBERTaV3_base2025.05 | 89.93 | 95.53 | 87.94 | 69.06 | 90.4 | 93.24 | 87 | 88.71 | 87.73 | |
| DoRAr=4, #Params=0.75M, Backbone=DeBERTaV3_base2025.05 | 89.92 | 95.41 | 89.1 | 69.37 | 91.53 | 94.14 | 87 | 91.8 | 88.53 | |
| Full-FT#Params=183.83M, Backbone=DeBERTaV3_base2025.05 | 89.9 | 95.63 | 89.46 | 69.19 | 92.4 | 94.03 | 83.75 | 91.6 | 88.25 | |
| SVFT-P#Params=0.06M, Backbone=DeBERTaV3_base2025.05 | 89.69 | 95.41 | 88.77 | 70.95 | 90.16 | 94.27 | 87.24 | 91.8 | 88.54 |