Entity Linking on WebQSP (test)
91.18PrecisionELA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ELATarget Knowledge Base=Wikipedia, Backbone=DeepSeek-V3, Protocol=few-shot (CoT)2025.08 | 91.18 | — | — | 92.55 | 88.2 | |
| ELQTarget Knowledge Base=Wikipedia2025.08 | 91.05 | — | — | 92.05 | 86.6 | |
| ReFinEDTarget Knowledge Base=Wikipedia2025.08 | 89.93 | — | — | 90.8 | 84.9 | |
| ELATarget Knowledge Base=Wikidata, Backbone=DeepSeek-V3, Protocol=few-shot (CoT)2025.08 | 86.4 | — | — | 88.2 | 83.4 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.1-8B, Protocol=fine-tuned2025.08 | 84.52 | — | — | 82.65 | 79.2 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=GPT-4.1, Protocol=few-shot (CoT)2025.08 | 84.45 | — | — | 84.7 | 82.4 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.1-8B, Protocol=fine-tuned2025.08 | 83.49 | — | — | 81.78 | 78.25 | |
| ELATarget Knowledge Base=Wikidata, Backbone=GPT-4.1, Protocol=few-shot (CoT)2025.08 | 80.14 | — | — | 81.15 | 78.2 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.3-70B, Protocol=few-shot (CoT)2025.08 | 79.12 | — | — | 83.83 | 74.22 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.3-70B, Protocol=few-shot (CoT)2025.08 | 74.77 | — | — | 77.77 | 69.66 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.1-8B, Protocol=few-shot2025.08 | 50.2 | — | — | 49.35 | 47 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.1-8B, Protocol=few-shot2025.08 | 46.4 | — | — | 45.75 | 42.6 | |
| AzureTarget Knowledge Base=Wikipedia2025.08 | 11.1 | — | — | 10.75 | 10.3 | |
| BLINKPre-training data=Wikipedia2022.07 | — | 80.8 | 0.8 | — | — | |
| ELQPre-training data=Wikipedia2022.07 | — | 83.9 | 1.56 | — | — | |
| ELQFine-tuning protocol=fine-tuned2022.07 | — | 89 | 1.56 | — | — | |
| ReFinEDPre-training data=Wikipedia2022.07 | — | 84.1 | 2.78 | — | — | |
| ReFinEDFine-tuning protocol=fine-tuned2022.07 | — | 89.1 | 2.78 | — | — | |
| TAGME2022.07 | — | 36.1 | 2.39 | — | — |