Text Classification on Banking77
93.29AccuracySDBN-Adapter
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SDBN-AdapterData %=100%, Base Model=BERT-base2026.06 | 93.29 | — | |
| AdapterData %=100%, Base Model=BERT-base2026.06 | 92.82 | — | |
| SDBN-LoRAData %=100%, Base Model=BERT-base2026.06 | 91.77 | — | |
| LoRAData %=100%, Base Model=BERT-base2026.06 | 91.56 | — | |
| SDBN-AdapterData %=50%, Base Model=BERT-base2026.06 | 91.41 | — | |
| Task-level fine-tuning2025.06 | 91.2 | — | |
| BitFitData %=100%, Base Model=BERT-base2026.06 | 90.67 | — | |
| SDBN-BitFitData %=100%, Base Model=BERT-base2026.06 | 90.66 | — | |
| AdapterData %=50%, Base Model=BERT-base2026.06 | 90.58 | — | |
| SDBN-LoRAData %=50%, Base Model=BERT-base2026.06 | 89.92 | — | |
| Many-shot (ours)Masking Strategy=mask all targets2025.06 | 89.8 | 89.8 | |
| LoRAData %=50%, Base Model=BERT-base2026.06 | 89.05 | — | |
| Many-shot (ours)Masking Strategy=mask last target2025.06 | 88.4 | 88.4 | |
| SDBN-BitFitData %=50%, Base Model=BERT-base2026.06 | 88.39 | — | |
| BitFitData %=50%, Base Model=BERT-base2026.06 | 87.67 | — | |
| Few-shotMasking Strategy=mask all targets2025.06 | 87.2 | 87.2 | |
| SDBN-AdapterData %=20%, Base Model=BERT-base2026.06 | 87.2 | — | |
| Few-shotMasking Strategy=mask last target2025.06 | 86.8 | 86.8 | |
| Many-shotStrategy=autoregressive2025.06 | 86.4 | 86.4 | |
| AdapterData %=20%, Base Model=BERT-base2026.06 | 86.18 | — | |
| SDBN-LoRAData %=20%, Base Model=BERT-base2026.06 | 84.81 | — | |
| Zero shot2025.06 | 84 | 84 | |
| LoRAData %=20%, Base Model=BERT-base2026.06 | 82.47 | — | |
| SDBN-BitFitData %=20%, Base Model=BERT-base2026.06 | 81.61 | — | |
| SDBN-AdapterData %=10%, Base Model=BERT-base2026.06 | 80.48 | — | |
| BitFitData %=20%, Base Model=BERT-base2026.06 | 79.59 | — | |
| AdapterData %=10%, Base Model=BERT-base2026.06 | 78.26 | — | |
| SDBN-LoRAData %=10%, Base Model=BERT-base2026.06 | 72.86 | — | |
| SDBN-BitFitData %=10%, Base Model=BERT-base2026.06 | 70.08 | — | |
| BitFitData %=10%, Base Model=BERT-base2026.06 | 67.45 | — | |
| LoRAData %=10%, Base Model=BERT-base2026.06 | 66.42 | — | |
| SDBN-AdapterData %=5%, Base Model=BERT-base2026.06 | 63.7 | — | |
| AdapterData %=5%, Base Model=BERT-base2026.06 | 58.69 | — | |
| No fine-tuning2025.06 | 55.8 | 55.8 | |
| SDBN-BitFitData %=5%, Base Model=BERT-base2026.06 | 48.21 | — | |
| BitFitData %=5%, Base Model=BERT-base2026.06 | 44.3 | — | |
| SDBN-LoRAData %=5%, Base Model=BERT-base2026.06 | 43.3 | — | |
| LoRAData %=5%, Base Model=BERT-base2026.06 | 36.29 | — |