Natural Language Explanation Generation on SBIC 60-shot
63.86AccuracyFull Fine-tuning
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Full Fine-tuningFine-tuning Strategy=Baseline, Backbone=Llama 2-7B, Percentage Parameters=100%, Few-shot setting=60-shot2023.05 | 63.86 | 57.42 | |
| SPARSEFITFine-tuning Strategy=Att.Q+LN, Backbone=Llama 2-7B, Percentage Parameters=7.97%, Few-shot setting=60-shot2023.05 | 57.9 | 50.41 | |
| AdaLoRAFine-tuning Strategy=PEFT, Backbone=Llama 2-7B, Percentage Parameters=0.30%, Few-shot setting=60-shot2023.05 | 57.29 | 50.63 |