Natural Language Understanding on GLUE (test) (Subset: MNLI, SST-2, CoLA, QNLI, MRPC)
86.89MNLI AccuracyFull
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FullBackbone=RoBERTa-base, Evaluation Protocol=finetuned2026.03 | 86.89 | 93.42 | 80.24 | 92.04 | 79.57 | |
| rsLoRABackbone=RoBERTa-base, Evaluation Protocol=finetuned, LoRA Rank=82026.03 | 85.54 | 92.96 | 79.16 | 77.25 | 78.34 | |
| CG-LoRA (no shift)Backbone=RoBERTa-base, Evaluation Protocol=finetuned, LoRA Rank=8, Initialization=shifted from W0 + ηB0A02026.03 | 85.51 | 93.19 | 80.53 | 91.43 | 82.27 | |
| CG-LoRA (shift)Backbone=RoBERTa-base, Evaluation Protocol=finetuned, LoRA Rank=8, Initialization=starting from W02026.03 | 85.35 | 93.19 | 72.77 | 91.14 | 75.4 | |
| LoRA-OneBackbone=RoBERTa-base, Evaluation Protocol=finetuned, LoRA Rank=82026.03 | 85.03 | 92.92 | 79.02 | 90.79 | 76.71 | |
| LoRA-GABackbone=RoBERTa-base, Evaluation Protocol=finetuned, LoRA Rank=82026.03 | 83.02 | 93.08 | 75.03 | 87.86 | 76.22 |