Natural Language Explanation Generation on ECQA
73.33Human Evaluation ScoreSPARSEFIT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPARSEFITBackbone=Llama-2-7B, Setting=Att.Q+LN2023.05 | 73.33 | — | |
| AdaLoraBackbone=Llama-2-7B2023.05 | 52.22 | — | |
| Full Fine-tuningBackbone=T5-large, Fine-tuning Strategy=Full Fine-tuning, Trainable Parameters (%)=100%2023.05 | 41.92 | 0.23 | |
| Full Fine-tuningBackbone=Llama-2-7B2023.05 | 38.89 | — | |
| SPARSEFIT (Att.Q)Backbone=T5-large, Fine-tuning Strategy=Att.Q2023.05 | 35.35 | 0.31 | |
| AdaLoraBackbone=T5-large, Fine-tuning Strategy=AdaLoRA, Trainable Parameters (%)=1.15%2023.05 | 34.44 | 0.26 | |
| SPARSEFIT (Att.Q+LN)Backbone=T5-large, Fine-tuning Strategy=Att.Q+LN2023.05 | 31.31 | 0.26 |