Natural Language Understanding on GLUE (All Subtasks Performance)
71.69CoLATASO
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TASOBackbone=DeBERTa-v3-base, #Param.=0.75 M, Iterative Training Rounds=42025.09 | 71.69 | 91.83 | 94.17 | 91.6 | 88.94 | 88.49 | 95.87 | 92.4 | 90.61 | 90.89 | 89.43 | |
| SoRABackbone=DeBERTa-v3-base, #Param.=1.33 M2025.09 | 71.48 | 91.98 | 94.28 | 92.39 | 89.87 | 87.77 | 95.64 | 92.22 | 90.35 | 90.38 | 89.36 | |
| LoRABackbone=DeBERTa-v3-base, #Param.=2.65 M, r=162025.09 | 69.87 | 89.91 | 93.46 | 92.22 | 89.63 | 87.05 | 95.53 | 91.79 | 90.55 | 90.31 | 88.62 | |
| TASOBackbone=DeBERTa-v3-base, #Param.=0.18 M2025.09 | 69.86 | 90.03 | 93.72 | 91.3 | 88.57 | 88.01 | 95.6 | 92.3 | 90.36 | 90.44 | 88.73 | |
| LoRABackbone=DeBERTa-v3-base, #Param.=1.33 M, r=82025.09 | 69.73 | 89.71 | 93.76 | 91.95 | 89.26 | 85.32 | 95.57 | 91.86 | 90.47 | 90.46 | 88.38 | |
| Fine-TuneBackbone=DeBERTa-v3-base, #Param.=184 M2025.09 | 69.21 | 89.22 | 93.78 | 92.05 | 89.31 | 82.49 | 95.64 | 91.59 | 89.98 | 89.95 | 87.82 | |
| AdapterBackbone=DeBERTa-v3-base, #Param.=1.41 M2025.09 | 69 | 89.9 | 93.79 | 91.45 | 88.88 | 82.44 | 95.16 | 91.45 | 90.11 | 90.11 | 87.85 | |
| BitfitBackbone=DeBERTa-v3-base, #Param.=0.1 M2025.09 | 68.7 | 87.16 | 91.9 | 87.86 | 84.2 | 76.12 | 94.38 | 89.71 | 87.45 | 87.45 | 85.18 |