List your company
ResearchFormerly WizWand

Continual Learning on TRACE LLM-CL

43.82Overall Performance (OP)CoDyRA
25.786430.468235.1539.8318Dec 1, 2024
Updated 5mo ago

Evaluation results

MethodLinks
CoDyRABackbone=LLaMA-2-7B-Chat, Category=capacity-controlled, Paradigm=Model continually learned2024.1243.823.25
TreeLoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.1243.523.46
O-LoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.1242.787.16
EWCBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.1242.365.97
OGDBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.1242.098.06
HiDeLoRABackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.1241.67.12
GEMBackbone=LLaMA-2-7B-Chat, Category=reference-constrained, Paradigm=Model continually learned2024.1240.086.77
FIX(ICL)Backbone=LLaMA-2-7B-Chat, Category=no training, Paradigm=Model complementation2024.1238.94—
DualPromptBackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.1237.698.03
CoDyRABackbone=LLaMA-3-1B-Instruct, Category=capacity-controlled, Paradigm=Model continually learned2024.1237.465.11
L2PBackbone=LLaMA-2-7B-Chat, Category=auxiliary modules, Paradigm=Model complementation2024.1236.238.25
TreeLoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.1236.147.36
SeqLoRABackbone=LLaMA-2-7B-Chat, Category=naïve LoRA, Paradigm=Model continually learned2024.1234.318.5
CoDyRABackbone=Gemma-2B-it, Category=capacity-controlled, Paradigm=Model continually learned2024.1233.967.94
O-LoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.1233.7312.36
HiDeLoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.1233.7312.36
TreeLoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.1233.418.5
HiDeLoRABackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.1233.2513.66
O-LoRABackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.1232.9412.89
OGDBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.1232.8512.27
DualPromptBackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.1232.4214.25
FIX(ICL)Backbone=Gemma-2B-it, Category=no training, Paradigm=Model complementation2024.1232.3—
GEMBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.1232.1910.74
EWCBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.1231.9611.62
SeqLoRABackbone=Gemma-2B-it, Category=naïve LoRA, Paradigm=Model continually learned2024.1231.8915.28
FIX(ICL)Backbone=LLaMA-3-1B-Instruct, Category=no training, Paradigm=Model complementation2024.1231.16—
L2PBackbone=Gemma-2B-it, Category=auxiliary modules, Paradigm=Model complementation2024.1231.1415.77
DualPromptBackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.1230.7611.34
OGDBackbone=LLaMA-3-1B-Instruct, Category=reference-constrained, Paradigm=Model continually learned2024.1230.1215.2
SeqLoRABackbone=LLaMA-3-1B-Instruct, Category=naïve LoRA, Paradigm=Model continually learned2024.1229.7317.03
L2PBackbone=LLaMA-3-1B-Instruct, Category=auxiliary modules, Paradigm=Model complementation2024.1229.3813.57
EWCBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.1228.3516.96
GEMBackbone=Gemma-2B-it, Category=reference-constrained, Paradigm=Model continually learned2024.1226.4818.25