Unimodal Language Generation on SuperNI Order 2
51.54APGainLoRA (O)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| GainLoRA (O)Backbone=LLaMA-7B, Task Order=Order 22026.05 | 51.54 | -0.21 | 33.64 | |
| CP-MoEBackbone=LLaMA-7B, Task Order=Order 22026.05 | 50.56 | 0.73 | 35.91 | |
| InfLoRABackbone=LLaMA-7B, Task Order=Order 22026.05 | 50.06 | -0.28 | 30.79 | |
| GainLoRA (Inf)Backbone=LLaMA-7B, Task Order=Order 22026.05 | 47.27 | 0.3 | 30.86 | |
| O-LoRABackbone=LLaMA-7B, Task Order=Order 22026.05 | 45.2 | 0.37 | 27.43 |