Natural Language Understanding on GLUE (test) (SST-2, RTE, QNLI Subset)
96.1SST-2 AccuracyShapLoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| ShapLoRABackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 96.1 | 89 | 95.1 | |
| AutoLoRABackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 95.5 | 87.6 | 93.9 | |
| LoRABackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 95.2 | 87.2 | 94.1 | |
| AdaLoRABackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 95.2 | 87.3 | 94 | |
| BitFitBackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 94.5 | 86.9 | 93.7 | |
| Housbly-AdapterBackbone=LlaMA-3 8B, Number of random seeds=52026.01 | 94.3 | 86.7 | 93.1 | |
| P-tuning v2Backbone=LlaMA-3 8B, Number of random seeds=52026.01 | 93.8 | 84.5 | 92.2 |