Natural Language Understanding on GLUE (CoLA, MRPC, RTE, SST-2)
64.6CoLA ScoreLoRA-Mixer
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LoRA-MixerBase Model=LLaMA2-7B, r=6, alpha=122025.06 | 64.6 | 80.31 | 72.24 | 61.47 | |
| LoRABase Model=LLaMA2-7B, r=6, alpha=122025.06 | 61.63 | 75.74 | 68 | 52.22 | |
| LEGOBase Model=LLaMA2-7B, r=6, alpha=122025.06 | 55.48 | 73.22 | 66 | 71.85 |