Continual Learning on Comprehensive NLP Benchmark Suite
47.13OP ScoreTreeLoRA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TreeLoRAFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 47.13 | 3.42 | 662 | |
| O-LoRAFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 44.32 | 5.19 | 1,839 | |
| GEMFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 43.77 | 8.42 | 9,931 | |
| HiDeLoRAFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 43.27 | 11.27 | 1,835 | |
| OGDFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 42.32 | 9.72 | 8,712 | |
| EWCFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 41.23 | 10.12 | 67,819 | |
| FIXFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 40.15 | — | — | |
| SeqLoRAFoundation Model=meta / Llama-2-13b-chat-hf2025.06 | 39.16 | 15.58 | 1,525 |