Natural Language Understanding on GLUE (CoLA, MNLI, MRPC, QNLI, QQP, RTE, SST-2)
88.2CoLA ScoreBayesLoRA
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| BayesLoRABackbone=DeBERTa-V3 base, initial rank (r)=16, seeds=32025.06 | 88.2 | 89.9 | 90.5 | 94.4 | 90.1 | 87.1 | 95.6 | — | — | |
| AdaLoRABackbone=DeBERTa-V3 base, seeds=32025.06 | 87.4 | 89.8 | 90 | 94.4 | 89.7 | 86 | 95.7 | — | — | |
| LoRABackbone=DeBERTa-V3 base, seeds=32025.06 | 85.8 | 89.6 | 83.2 | 93.8 | 90 | 82.9 | 95.2 | — | — | |
| BaselineProtect=None, Attack=None, Backbone=GPT-22026.06 | 68.26 | 68.3 | 71.81 | 66.9 | 80.79 | 46.21 | 79.24 | 68.79 | — | |
| AGAProtect=Params, Attack=AGA, Backbone=GPT-22026.06 | 68.26 | 62.87 | 71.81 | 65.5 | 78.53 | 45.85 | 77.75 | 67.22 | 15.78 | |
| -Protect=-, Attack=-, Backbone=GPT-22026.06 | 68.26 | 68.3 | 71.81 | 66.9 | 80.79 | 46.21 | 79.24 | 68.79 | — | |
| AGAProtect=Params-P, Attack=AGA, Backbone=GPT-22026.06 | 68.17 | 62.06 | 71.69 | 64.31 | 77.26 | 45.66 | 76.51 | 66.52 | 15.97 | |
| AGAProtect=MergeLock, Attack=AGA, Backbone=GPT-22026.06 | 68.07 | 64 | 71.81 | 63.35 | 80.45 | 46.21 | 77.75 | 67.38 | 12.58 | |
| ParamsProtect=Params, Attack=None, Backbone=GPT-22026.06 | 66.03 | 34.42 | 41.18 | 54.99 | 65.16 | 42.57 | 55.73 | 51.44 | — | |
| MergeGuardProtect=MergeGuard, Attack=-, Backbone=GPT-22026.06 | 65.31 | 48.23 | 65.06 | 55.27 | 64.41 | 42.8 | 66.35 | 58.2 | — | |
| Params-PProtect=Params-P, Attack=None, Backbone=GPT-22026.06 | 65.29 | 32.08 | 41.24 | 54.26 | 64.72 | 42.1 | 54.19 | 50.55 | — | |
| AGAProtect=MergeBarrier, Attack=AGA, Backbone=GPT-22026.06 | 65.19 | 56.18 | 68.14 | 60.26 | 70.4 | 46.21 | 52.64 | 59.86 | 9.17 | |
| MergeLockProtect=MergeLock, Attack=None, Backbone=GPT-22026.06 | 63.85 | 37.04 | 64.46 | 51.36 | 57.88 | 41.29 | 67.75 | 54.8 | — | |
| ARFProtect=ARF, Attack=AGA, Backbone=GPT-22026.06 | 63.5 | 37.78 | 62.29 | 53.62 | 60.25 | 42 | 64.94 | 54.91 | — | |
| ARFProtect=ARF, Attack=-, Backbone=GPT-22026.06 | 61.09 | 35.29 | 60.55 | 51.97 | 52.61 | 41.35 | 63.06 | 52.27 | — | |
| MergeBarrierProtect=MergeBarrier, Attack=None, Backbone=GPT-22026.06 | 60.97 | 34.89 | 42.89 | 57.24 | 59.45 | 42.38 | 56.99 | 50.69 | — |