Natural Language Understanding on GLUE (test) (MRPC, CoLA, SST-2, QNLI, MNLI)
86.8MRPC ScorePiSSA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| PiSSABackbone=T5-base, r/N=r=8, #Params=1.1%2025.06 | 86.8 | 78.5 | 93.7 | 92.9 | 85.3 | 87.4 | |
| DiaBloBackbone=T5-base, r/N=N=64, #Params=1.1%2025.06 | 86 | 80.5 | 94.3 | 93 | 85.4 | 87.8 | |
| Full FTBackbone=T5-base, r/N=–, #Params=100%2025.06 | 84.6 | 80.7 | 94.8 | 93.2 | 86.3 | 87.9 | |
| LoRABackbone=T5-base, r/N=r=8, #Params=1.1%2025.06 | 84.3 | 79.6 | 94.1 | 93 | 85.7 | 87.3 | |
| DoRABackbone=T5-base, r/N=r=8, #Params=1.1%2025.06 | 83.9 | 79.1 | 94.4 | 93.1 | 85.3 | 87.2 |