Natural Language Explanation Generation on e-SNLI (test)
86.66AccuracyAdaLoRA (4.48%)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| AdaLoRA (4.48%)Trainable Parameters=4.48%, FLOPS=2.87e14, Base Model=T5-large2023.05 | 86.66 | 72.19 | |
| (IA)³Trainable Parameters=0.07%, FLOPS=2.74e14, Base Model=T5-large2023.05 | 86.64 | 72.18 | |
| AdaLoRA (1.15%)Trainable Parameters=1.15%, FLOPS=1.48e15, Base Model=T5-large2023.05 | 84.5 | 77.43 | |
| LoRA (Att.QV, Rank=128)Trainable Parameters=4.86%, FLOPS=2.88e14, Base Model=T5-large2023.05 | 84.26 | 76.49 | |
| LoRA (Att.KQVO, Rank=4)Trainable Parameters=0.32%, FLOPS=2.75e14, Base Model=T5-large2023.05 | 84.05 | 77.04 | |
| SPARSEFIT (Att.Q+LN)Trainable Parameters=6.84%, FLOPS=2.37e14, Base Model=T5-large2023.05 | 82.62 | 75.63 |