Entity Linking on GERBIL
86.5InKB Micro F1 (AIDA-B)FUSIONED
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| FUSIONED2024.04 | 86.5 | 73.6 | 56.8 | 62 | 56.8 | 65.1 | 53.1 | 41.6 | 62.3 | |
| Zhang et al.2024.04 | 85.8 | 72.1 | 52.9 | 64.5 | 54.1 | 41.9 | 61.1 | 51.3 | 60.5 | |
| Shavarani and Sarkar2024.04 | 85.8 | 63.1 | 59.1 | 53.7 | 47.1 | 44.4 | 59.5 | 56.6 | 58.7 | |
| De Cao et al.evaluation_variant=High-Performant AIDA-B2024.04 | 85.5 | — | — | — | — | — | — | — | — | |
| De Cao et al.evaluation_variant=Standard2024.04 | 83.7 | 73.7 | 54.1 | 60.7 | 46.7 | 40.3 | 56.1 | 50 | 58.2 | |
| Kolitsas et al.2024.04 | 82.4 | 72.4 | 34.1 | 35.2 | 50.3 | 38.2 | 61.9 | 52.7 | 53.4 | |
| Martins et al.2024.04 | 81.9 | — | — | — | — | — | — | — | — | |
| Van Hulst et al.2024.04 | 80.5 | 72.4 | 41.1 | 50.7 | 49.9 | 35 | 63.1 | 58.3 | 56.4 | |
| Broscheit2024.04 | 79.3 | — | — | — | — | — | — | — | — | |
| Hoffart et al.2024.04 | 72.8 | 65.1 | 32.6 | 55.4 | 46.4 | 42.4 | 63.1 | 0 | 47.2 | |
| GPT-4 + retrieval*mode=zero-shot, candidate_filtering=true2024.04 | 59.1 | 42.5 | 41 | 67.6 | 36.4 | 30.1 | 58.4 | 53 | 48.5 | |
| GPT-4 + retrievalmode=zero-shot2024.04 | 58.4 | 42.4 | 40.1 | 69 | 35.1 | 29.4 | 58.3 | 53.1 | 48.3 | |
| GPT-4mode=zero-shot, source=Shavarani and Sarkar (2023)2024.04 | 54.1 | — | — | — | — | — | — | — | — | |
| Moro et al.2024.04 | 48.5 | 39.7 | 29.8 | 55.9 | 23 | 29.1 | 41.9 | 37.7 | 38.2 | |
| Steinmetz and Sack2024.04 | 42.3 | 30.9 | 26.5 | 46.8 | 18.1 | 20.5 | 46.2 | 46.4 | 34.7 |