Knowledge Probing on LAMA-CKL (test)
42.9Top AccuracyTA (Llama)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TA (Llama)Generation Model=Llama2 7B, Parameter size of TA=1.1B, Epoch=42024.07 | 42.9 | 89.83 | 132.73 | |
| TA (Llama)Generation Model=Tinyllama 1B, Parameter size of TA=1.1B, Epoch=42024.07 | 32.6 | 90.78 | 123.38 | |
| TA (BERT)Generation Model=Llama2 7B, Parameter size of TA=108M, Epoch=62024.07 | 32.1 | 93.88 | 125.98 | |
| TA (BERT)Generation Model=Tinyllama 1B, Parameter size of TA=108M, Epoch=92024.07 | 24.4 | 92.67 | 117.07 | |
| FinetuneGeneration Model=Llama2 7B, Parameter size of TA=NA, Epoch=162024.07 | 11.5 | 81.74 | 93.24 | |
| FinetuneGeneration Model=Tinyllama 1B, Parameter size of TA=NA, Epoch=292024.07 | 7 | 76.93 | 83.93 |