Continual Instruction Tuning on NI-Seq-C1
80.16APLoraInc
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LoraIncBackbone=Qwen3-8b2026.06 | 80.16 | 0.34 | -8 | |
| LoraIncBackbone=Qwen3-14b2026.06 | 80 | -0.32 | 10.45 | |
| InsCLBackbone=Qwen3-8b2026.06 | 79.4 | -0.43 | -11 | |
| O-LoraBackbone=Qwen3-14b2026.06 | 78.61 | -0.2 | 12.66 | |
| EWCBackbone=Qwen3-8b2026.06 | 78.54 | -0.44 | -5.93 | |
| O-LoraBackbone=Qwen3-8b2026.06 | 76.95 | 0.42 | -6.99 | |
| LoraIncBackbone=Llama2-13b2026.06 | 76.91 | -1.09 | 23.32 | |
| LoraIncBackbone=Llama2-7b-chat2026.06 | 76.54 | -0.57 | 4.39 | |
| O-LoraBackbone=Llama2-13b2026.06 | 76.52 | -1.51 | 22.53 | |
| InsCLBackbone=Llama2-7b-chat2026.06 | 75.89 | -0.25 | 3.31 | |
| EWCBackbone=Llama2-7b-chat2026.06 | 73.3 | -0.74 | 6.63 | |
| O-LoraBackbone=Llama2-7b-chat2026.06 | 71.27 | -0.56 | 4.05 | |
| EWC + SAPOBackbone=Qwen3-8b2026.06 | 1.73 | 0.58 | 1.88 | |
| EWC + SAPOBackbone=Llama2-7b-chat2026.06 | 1.43 | 0.23 | 1.39 | |
| O-Lora + SAPOBackbone=Llama2-7b-chat2026.06 | 1.23 | 0.75 | 0.3 | |
| O-Lora + SAPOBackbone=Qwen3-14b2026.06 | 1.02 | 0.12 | 1.76 | |
| O-Lora + SAPOBackbone=Llama2-13b2026.06 | 0.94 | -0.12 | 1.35 | |
| InsCL + SAPOBackbone=Llama2-7b-chat2026.06 | 0.69 | 0.3 | 0.02 | |
| LoraInc + SAPOBackbone=Qwen3-8b2026.06 | 0.62 | 0.18 | 1.98 | |
| O-Lora + SAPOBackbone=Qwen3-8b2026.06 | 0.57 | 0.16 | 1.64 | |
| InsCL + SAPOBackbone=Qwen3-8b2026.06 | 0.54 | 0.43 | 0.3 | |
| LoraInc + SAPOBackbone=Qwen3-14b2026.06 | 0.43 | 0.48 | 1.72 | |
| LoraInc + SAPOBackbone=Llama2-13b2026.06 | 0.29 | 0.12 | 2.69 | |
| LoraInc + SAPOBackbone=Llama2-7b-chat2026.06 | 0.16 | 0.49 | 1.76 |