List your company
ResearchFormerly WizWand

Continual Knowledge Learning on LAMA-CKL (test)

32.6Top AccTAALM(QLORA)
1.1929.34617.525.654Jul 24, 2024
Updated 8mo ago

Evaluation results

MethodLinks
TAALM(QLORA)Architecture=TinyLlama-1B, Epoch=4, Optimization=QLoRA2024.0732.690.78123.38
RHO-1(QLORA)Architecture=TinyLlama-1B, Epoch=13, Optimization=QLoRA2024.07985.2394.23
Finetune(QLORA)Architecture=TinyLlama-1B, Epoch=29, Optimization=QLoRA2024.07776.9383.93
Mix-review(QLORA)Architecture=TinyLlama-1B, Epoch=23, Optimization=QLoRA2024.07681.6187.61
RecAdam(QLORA)Architecture=TinyLlama-1B, Epoch=29, Optimization=QLoRA2024.07677.1983.19
K-AdapterArchitecture=TinyLlama-1B, Epoch=222024.072.499.08101.48