Unimodal Language Generation on SuperNI (Order 1)
50.84APCP-MoE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| CP-MoEBackbone=LLaMA-7B, Task Order=Order 12026.05 | 50.84 | 0.62 | 35.8 | |
| O-LoRABackbone=LLaMA-7B, Task Order=Order 12026.05 | 50.12 | -2.1 | 33.3 | |
| GainLoRA (O)Backbone=LLaMA-7B, Task Order=Order 12026.05 | 49.6 | 0.82 | 33.8 | |
| InfLoRABackbone=LLaMA-7B, Task Order=Order 12026.05 | 47.28 | 1.05 | 27.43 | |
| GainLoRA (Inf)Backbone=LLaMA-7B, Task Order=Order 12026.05 | 45.57 | -0.28 | 27.77 |