Continual Learning on Math-LLM ScienceQA, NumGLUE-cm, and NumGLUE-ds
50.97Order Preservation (OP)CRAFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CRAFTFoundation Model=Llama-2-7B-Chat2026.05 | 50.97 | 2.83 | |
| TreeLoRAFoundation Model=Llama-2-7B-Chat2026.05 | 45.59 | 2.32 | |
| TreeLoRAFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 45.59 | 2.32 | |
| HiDeLoRAFoundation Model=Llama-2-7B-Chat2026.05 | 42.83 | 11.92 | |
| HiDeLoRAFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 42.83 | 11.92 | |
| OGDFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 42.09 | 8.06 | |
| O-LoRAFoundation Model=Llama-2-7B-Chat2026.05 | 42 | 11.67 | |
| O-LoRAFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 42 | 11.67 | |
| GEMFoundation Model=Llama-2-7B-Chat2026.05 | 40.75 | 16.25 | |
| GEMFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 40.75 | 16.25 | |
| SeqLoRAFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 40.24 | 9.12 | |
| DualPromptFoundation Model=Llama-2-7B-Chat2026.05 | 37.72 | 9.54 | |
| DualPromptFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 37.72 | 9.54 | |
| EWCFoundation Model=Llama-2-7B-Chat2026.05 | 37.25 | 17.5 | |
| EWCFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 37.25 | 17.5 | |
| FIX (ICL)Foundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 36.92 | — | |
| L2PFoundation Model=Llama-2-7B-Chat2026.05 | 31.67 | 2.54 | |
| L2PFoundation model=LLaMA-2-7B-chat, Number of runs=32025.06 | 31.67 | 2.54 |