Entity Linking on CWQ (test)
82.43PrecisionELA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ELATarget Knowledge Base=Wikipedia, Backbone=DeepSeek-V3, Protocol=few-shot (CoT)2025.08 | 82.43 | 84.04 | 73.05 | |
| ELQTarget Knowledge Base=Wikipedia2025.08 | 81.77 | 82.35 | 68.4 | |
| ReFinEDTarget Knowledge Base=Wikipedia2025.08 | 81.46 | 83.48 | 68.9 | |
| ELATarget Knowledge Base=Wikidata, Backbone=DeepSeek-V3, Protocol=few-shot (CoT)2025.08 | 81.44 | 82.72 | 68.4 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.1-8B, Protocol=fine-tuned2025.08 | 78.65 | 67.75 | 54.5 | |
| AzureTarget Knowledge Base=Wikipedia2025.08 | 78.1 | 79.07 | 60.6 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.1-8B, Protocol=fine-tuned2025.08 | 78 | 68.02 | 55.8 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.3-70B, Protocol=few-shot (CoT)2025.08 | 73.39 | 69.64 | 59.81 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=GPT-4.1, Protocol=few-shot (CoT)2025.08 | 69.3 | 65.85 | 59.3 | |
| ELATarget Knowledge Base=Wikidata, Backbone=GPT-4.1, Protocol=few-shot (CoT)2025.08 | 65.83 | 63.35 | 56.7 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.3-70B, Protocol=few-shot (CoT)2025.08 | 51.46 | 50.34 | 44.72 | |
| ELATarget Knowledge Base=Wikidata, Backbone=Llama-3.1-8B, Protocol=few-shot2025.08 | 50.04 | 44.12 | 35.5 | |
| ELATarget Knowledge Base=Wikipedia, Backbone=Llama-3.1-8B, Protocol=few-shot2025.08 | 46.49 | 43.18 | 38.84 |