Natural Language Explanation Generation on SBIC
71.11Human Evaluation ScoreAdaLora
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AdaLoraBackbone=Llama-2-7B2023.05 | 71.11 | — | |
| SPARSEFITBackbone=Llama-2-7B, Setting=Att.Q+LN2023.05 | 68.89 | — | |
| SPARSEFIT (Att.Q)Backbone=T5-large, Fine-tuning Strategy=Att.Q2023.05 | 61.11 | 0.77 | |
| AdaLoraBackbone=T5-large, Fine-tuning Strategy=AdaLoRA, Trainable Parameters (%)=1.15%2023.05 | 61.11 | 0.69 | |
| SPARSEFIT (Att.Q+LN)Backbone=T5-large, Fine-tuning Strategy=Att.Q+LN2023.05 | 58.89 | 0.69 | |
| Full Fine-tuningBackbone=T5-large, Fine-tuning Strategy=Full Fine-tuning, Trainable Parameters (%)=100%2023.05 | 54.44 | 0.7 | |
| Full Fine-tuningBackbone=Llama-2-7B2023.05 | 47.78 | — |