Relation Extraction on WikiText-103 relational questions (test)
86.9Accuracy (Country_Curr)LIT
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| LITBackbone=Llama-3-8B-Instruct, Layers=first 15, Confidence Interval=99%2024.12 | 86.9 | 68.9 | 65.2 | 90.4 | 71.5 | 39.2 | |
| PatchscopeBackbone=Llama-3-8B-Instruct, Layers=first 15, Confidence Interval=99%2024.12 | 24.3 | 36.2 | 51 | 28.9 | 28 | 24.6 | |
| Linear ProbeBackbone=Llama-3-8B-Instruct, Layers=first 15, Confidence Interval=99%2024.12 | 17.7 | 5.1 | 75.9 | 53.8 | 58.9 | 17.5 |