Natural Language Explanation Generation on ECQA (test)
59.4AccuracyAdaLoRA (4.48%)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AdaLoRA (4.48%)Trainable Parameters=4.48%, FLOPS=2.87e14, Base Model=T5-large2023.05 | 59.4 | 48.3 | |
| (IA)³Trainable Parameters=0.07%, FLOPS=2.74e14, Base Model=T5-large2023.05 | 59.14 | 48.08 | |
| SPARSEFIT (Att.Q+LN)Trainable Parameters=6.84%, FLOPS=2.37e14, Base Model=T5-large2023.05 | 55.81 | 45.88 | |
| AdaLoRA (1.15%)Trainable Parameters=1.15%, FLOPS=1.48e15, Base Model=T5-large2023.05 | 46.6 | 41.22 | |
| LoRA (Att.QV, Rank=128)Trainable Parameters=4.86%, FLOPS=2.88e14, Base Model=T5-large2023.05 | 43.51 | 0.33 | |
| LoRA (Att.KQVO, Rank=4)Trainable Parameters=0.32%, FLOPS=2.75e14, Base Model=T5-large2023.05 | 39.04 | 33.52 |