Natural Language Explanation Generation on SBIC (test)
66.99AccuracySPARSEFIT (Att.Q+LN)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SPARSEFIT (Att.Q+LN)Trainable Parameters=6.84%, FLOPS=2.37e14, Base Model=T5-large2023.05 | 66.99 | 64.29 | |
| LoRA (Att.QV, Rank=128)Trainable Parameters=4.86%, FLOPS=2.88e14, Base Model=T5-large2023.05 | 63.57 | 61.06 | |
| LoRA (Att.KQVO, Rank=4)Trainable Parameters=0.32%, FLOPS=2.75e14, Base Model=T5-large2023.05 | 62.66 | 59.8 | |
| AdaLoRA (1.15%)Trainable Parameters=1.15%, FLOPS=1.48e15, Base Model=T5-large2023.05 | 61.8 | 58.91 | |
| (IA)³Trainable Parameters=0.07%, FLOPS=2.74e14, Base Model=T5-large2023.05 | 48.08 | 48.06 | |
| AdaLoRA (4.48%)Trainable Parameters=4.48%, FLOPS=2.87e14, Base Model=T5-large2023.05 | 0.18 | 0.15 |