Temporal Knowledge Probing on TemporalWiki TWiki-Probes-0910
9.999Score (Unchanged)Finetune
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| FinetuneBackbone=TinyLlama-1B, Adapter Type=QLORA2024.07 | 9.999 | 10.057 | 10.028 | |
| Mix-reviewBackbone=TinyLlama-1B, Adapter Type=QLORA2024.07 | 9.529 | 9.579 | 9.554 | |
| RecAdamBackbone=TinyLlama-1B, Adapter Type=QLORA2024.07 | 9.514 | 9.604 | 9.559 | |
| RHO-1Backbone=TinyLlama-1B, Adapter Type=QLORA2024.07 | 4.389 | 4.624 | 4.507 | |
| TAALMBackbone=TinyLlama-1B, Adapter Type=QLORA2024.07 | 4.019 | 4.268 | 4.1435 | |
| FinetuneBackbone=TinyLlama-1B, Adapter Type=K-Adapter2024.07 | 2.768 | 2.982 | 2.875 | |
| RHO-1Backbone=TinyLlama-1B, Adapter Type=K-Adapter2024.07 | 2.722 | 2.95 | 2.836 | |
| RecAdamBackbone=TinyLlama-1B, Adapter Type=K-Adapter2024.07 | 2.494 | 2.71 | 2.602 | |
| Mix-reviewBackbone=TinyLlama-1B, Adapter Type=K-Adapter2024.07 | 2.486 | 2.724 | 2.605 | |
| TAALMBackbone=TinyLlama-1B, Adapter Type=K-Adapter, Training Context=Optimized on LAMA-CKL2024.07 | 2.364 | 2.601 | 2.483 | |
| TAALMBackbone=TinyLlama-1B, Adapter Type=K-Adapter2024.07 | 1.98 | 2.194 | 1.9705 |