Continual Learning on TRACE LLM-CL
43.82Overall Performance (OP)CoDyRA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| CoDyRABackbone=LLaMA-2-7B-Chat, Category=capacity-controlled, Paradigm=Model continually learned2024.12 | 43.82 | 3.25 | |
| TreeLoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 43.52 | 3.46 | |
| O-LoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 42.78 | 7.16 | |
| EWCBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 42.36 | 5.97 | |
| OGDBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 42.09 | 8.06 | |
| HiDeLoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 41.6 | 7.12 | |
| GEMBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 40.08 | 6.77 | |
| FIX(ICL)Backbone=LLaMA-2-7B-Chat, Category=no training, Paradigm=Model complementation2024.12 | 38.94 | — | |
| DualPromptBackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 37.69 | 8.03 | |
| CoDyRABackbone=LLaMA-3-1B-Instruct, Category=capacity-controlled, Paradigm=Model continually learned2024.12 | 37.46 | 5.11 | |
| L2PBackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 36.23 | 8.25 | |
| TreeLoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 36.14 | 7.36 | |
| SeqLoRABackbone=LLaMA-2-7B-Chat, Category=naïve LoRA, Paradigm=Model continually learned2024.12 | 34.3 | 18.5 | |
| CoDyRABackbone=Gemma-2B-it, Category=capacity-controlled, Paradigm=Model continually learned2024.12 | 33.96 | 7.94 | |
| O-LoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 33.73 | 12.36 | |
| HiDeLoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 33.73 | 12.36 | |
| TreeLoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 33.41 | 8.5 | |
| HiDeLoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 33.25 | 13.66 | |
| O-LoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 32.94 | 12.89 | |
| OGDBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 32.85 | 12.27 | |
| DualPromptBackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 32.42 | 14.25 | |
| FIX(ICL)Backbone=Gemma-2B-it, Category=no training, Paradigm=Model complementation2024.12 | 32.3 | — | |
| GEMBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 32.19 | 10.74 | |
| EWCBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 31.96 | 11.62 | |
| SeqLoRABackbone=Gemma-2B-it, Category=naïve LoRA, Paradigm=Model continually learned2024.12 | 31.89 | 15.28 | |
| FIX(ICL)Backbone=LLaMA-3-1B-Instruct, Category=no training, Paradigm=Model complementation2024.12 | 31.16 | — | |
| L2PBackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 31.14 | 15.77 | |
| DualPromptBackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 30.76 | 11.34 | |
| OGDBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 30.12 | 15.2 | |
| SeqLoRABackbone=LLaMA-3-1B-Instruct, Category=naïve LoRA, Paradigm=Model continually learned2024.12 | 29.73 | 17.03 | |
| L2PBackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.12 | 29.38 | 13.57 | |
| EWCBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 28.35 | 16.96 | |
| GEMBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.12 | 26.48 | 18.25 |