Linguistic Acceptability on CoLA (test)
86.34Avg AccuracyMAS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| MASlambda_a=0.3, lambda_s=0.72020.11 | 86.34 | 86.91 | — | — | |
| MASlambda_a=0.4, lambda_s=0.62020.11 | 86.18 | 87.66 | — | — | |
| MASlambda_a=0.5, lambda_s=0.52020.11 | 85.92 | 86.72 | — | — | |
| MASlambda_a=0.6, lambda_s=0.42020.11 | 85.45 | 86.34 | — | — | |
| MASlambda_a=0.7, lambda_s=0.32020.11 | 84.66 | 85.78 | — | — | |
| SGDlambda_a=0, lambda_s=12020.11 | 81.48 | 81.78 | — | — | |
| Adamlambda_a=1, lambda_s=02020.11 | 79.85 | 83.3 | — | — | |
| AdamW2020.11 | 78.59 | 85.96 | — | — | |
| C-PaCABackbone=RoBERTa-Large2026.06 | 70.1 | — | — | — | |
| FFTModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 69.7 | — | — | 1.047 | |
| FFTBackbone=RoBERTa-Large2026.06 | 69.7 | — | — | — | |
| AsymModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 69.3 | — | — | 1.042 | |
| PaCABackbone=RoBERTa-Large2026.06 | 69 | — | — | — | |
| CoLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 68.4 | — | — | 1.027 | |
| RACModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 68.1 | — | — | 1.023 | |
| LoRABackbone=RoBERTa-Large2026.06 | 67.6 | — | — | — | |
| PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 67.3 | — | — | 1.012 | |
| RACBackbone=RoBERTa-Large2026.06 | 67.2 | — | — | — | |
| r-cLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 67.1 | — | — | 1.008 | |
| D-PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 67.1 | — | — | 1.009 | |
| AsymBackbone=RoBERTa-Large2026.06 | 67 | — | — | — | |
| r-c3LABackbone=RoBERTa-Large2026.06 | 66.8 | — | — | — | |
| LoRAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 66.6 | — | — | 1 | |
| c3LAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 66.4 | — | — | 0.997 | |
| r-c3LAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 66.4 | — | — | 0.997 | |
| D-PaCABackbone=RoBERTa-Large2026.06 | 66.3 | — | — | — | |
| LoRAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 65.8 | — | — | 1 | |
| c3LABackbone=RoBERTa-Large2026.06 | 65.8 | — | — | — | |
| C-PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 65.4 | — | — | 0.982 | |
| CoLABackbone=RoBERTa-Base2026.06 | 65.1 | — | — | — | |
| cLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 65 | — | — | 0.976 | |
| r-c3LABackbone=RoBERTa-Base2026.06 | 64.3 | — | — | — | |
| cLABackbone=RoBERTa-Large2026.06 | 64.3 | — | — | — | |
| CoLABackbone=RoBERTa-Large2026.06 | 64.2 | — | — | — | |
| r-cLABackbone=RoBERTa-Large2026.06 | 64 | — | — | — | |
| FFTModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 62.7 | — | — | 0.953 | |
| FFTBackbone=RoBERTa-Base2026.06 | 62.7 | — | — | — | |
| r-cLABackbone=RoBERTa-Base2026.06 | 62.3 | — | — | — | |
| RACBackbone=RoBERTa-Base2026.06 | 62.1 | — | — | — | |
| C-PaCABackbone=RoBERTa-Base2026.06 | 62.1 | — | — | — | |
| CoLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 61.2 | — | — | 0.931 | |
| LoRABackbone=RoBERTa-Base2026.06 | 60.9 | — | — | — | |
| AsymBackbone=RoBERTa-Base2026.06 | 60.7 | — | — | — | |
| D-PaCABackbone=RoBERTa-Base2026.06 | 60.5 | — | — | — | |
| PaCABackbone=RoBERTa-Base2026.06 | 60.3 | — | — | — | |
| RACModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 60 | — | — | 0.911 | |
| r-cLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 59.5 | — | — | 0.904 | |
| AsymModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 59.3 | — | — | 0.901 | |
| cLABackbone=RoBERTa-Base2026.06 | 59.3 | — | — | — | |
| c3LABackbone=RoBERTa-Base2026.06 | 59.2 | — | — | — | |
| c3LAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 58.4 | — | — | 0.887 | |
| cLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 58.1 | — | — | 0.883 | |
| PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 57.9 | — | — | 0.88 | |
| r-c3LAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 57.6 | — | — | 0.876 | |
| C-PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 57.6 | — | — | 0.875 | |
| D-PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 57.1 | — | — | 0.868 | |
| cLAModel=RoBERTa-Large [42], Adapter rank=162026.06 | — | — | 0.5947 | — | |
| FFTModel=RoBERTa-Large [42]2026.06 | — | — | 0.6458 | — | |
| LoRAModel=RoBERTa-Large [42], Adapter rank=162026.06 | — | — | 0.6242 | — | |
| MajorityBackbone=RoBERTa-LARGE, Supervision Setting=Full2023.05 | — | — | 0 | — | |
| Prompt-based FT (hard) + PCPBackbone=RoBERTa-LARGE, Supervision Setting=Full, Evaluation Protocol=Prompt-based Fine-tuning (hard), Continued Pre-training=PCP2023.05 | — | — | 56 | — | |
| Prompt-based FT (soft) + PCPBackbone=RoBERTa-LARGE, Supervision Setting=Semi-supervised (16-shot), Evaluation Protocol=Prompt-based Fine-tuning (soft), Continued Pre-training=PCP2023.05 | — | — | 21.5 | — |