Natural Language Understanding on GLUE (MRPC, COLA, RTE, SST-2, QNLI Subset)
88.97MRPC ScoreTLoRA
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TLoRATrainable Parameters=5.44M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 88.97 | 82.93 | 71.48 | 93.8 | 92.62 | 85.96 | |
| PISSATrainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 88.72 | 81.2 | 69.67 | 94.03 | 92.6 | 85.24 | |
| CorDATrainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 88.48 | 81.78 | 71.11 | 93.92 | 92.75 | 85.6 | |
| LoRA-GATrainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 88.23 | 82.83 | 69.31 | 94.61 | 93 | 85.59 | |
| FULLTrainable Parameters=222.90M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 87.99 | 81.3 | 58.48 | 93.69 | 93.09 | 82.91 | |
| OLoRATrainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 87.99 | 75.83 | 66.78 | 90.13 | 90.48 | 82.24 | |
| DoRATrainable Parameters=13.17M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 86.51 | 81.2 | 59.56 | 94.26 | 93.06 | 82.91 | |
| LoRATrainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 85.53 | 76.03 | 63.17 | 94.49 | 93 | 83.44 | |
| AdaLoRATrainable Parameters=12.98M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 71.81 | 81.01 | 54.87 | 93.69 | 92.89 | 78.85 | |
| LoRA+Trainable Parameters=12.97M, Base Model=T5-base, Evaluation Protocol=Fine-tuning2026.04 | 66.66 | 70.75 | 51.26 | 93.8 | 92.73 | 75.04 |