Knowledge Probing on LAMA-CKL small generation model (Tinyllama 1B)
32.6Top-K AccTA (Llama)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TA (Llama)Parameter size of TA=1.1B, Epoch=4, Generation Model=Tinyllama 1B2024.07 | 32.6 | 90.78 | 123.38 | |
| TA (BERT)Parameter size of TA=108M, Epoch=9, Generation Model=Tinyllama 1B2024.07 | 24.4 | 92.67 | 117.07 | |
| FinetuneParameter size of TA=NA, Epoch=29, Generation Model=Tinyllama 1B2024.07 | 7 | 76.93 | 83.93 |