Continual Knowledge Learning on LAMA-CKL (test)
32.6Top AccTAALM(QLORA)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TAALM(QLORA)Architecture=TinyLlama-1B, Epoch=4, Optimization=QLoRA2024.07 | 32.6 | 90.78 | 123.38 | |
| RHO-1(QLORA)Architecture=TinyLlama-1B, Epoch=13, Optimization=QLoRA2024.07 | 9 | 85.23 | 94.23 | |
| Finetune(QLORA)Architecture=TinyLlama-1B, Epoch=29, Optimization=QLoRA2024.07 | 7 | 76.93 | 83.93 | |
| Mix-review(QLORA)Architecture=TinyLlama-1B, Epoch=23, Optimization=QLoRA2024.07 | 6 | 81.61 | 87.61 | |
| RecAdam(QLORA)Architecture=TinyLlama-1B, Epoch=29, Optimization=QLoRA2024.07 | 6 | 77.19 | 83.19 | |
| K-AdapterArchitecture=TinyLlama-1B, Epoch=222024.07 | 2.4 | 99.08 | 101.48 |