Multimodal Entity Linking on WikiDiverse (test)
92.9Hit@1UniMEL
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UniMELVenue=CIKM, #Params=15B, Entity Size (bytes)=81922026.06 | 92.9 | — | — | — | |
| KGMEL+RRVenue=SIGIR, #Params=†*, Entity Size (bytes)=10242026.06 | 88.23 | — | — | 90.84 | |
| GEMELMethod Type=Generative2024.06 | 86.3 | — | — | — | |
| FAST-MEL#Params=150M, Entity Size (bytes)=10242026.06 | 84.48 | — | — | 89.18 | |
| FissFuse+KARVenue=ACM MM, #Params=7B, Entity Size (bytes)=19 2002026.06 | 83.29 | — | — | 89.81 | |
| KGMELVenue=SIGIR, #Params=*, Entity Size (bytes)=10242026.06 | 82.12 | — | — | 86 | |
| FissFuseVenue=ACM MM, #Params=150M, Entity Size (bytes)=19 2002026.06 | 80.3 | — | — | 88.11 | |
| MMoE+DMEVenue=KDD, #Params=†, Entity Size (bytes)=17 2802026.06 | 77.57 | — | — | 84.23 | |
| MMoEVenue=KDD, #Params=150M, Entity Size (bytes)=17 2802026.06 | 74.59 | — | — | 75.43 | |
| M3ELVenue=KDD, #Params=150M, Entity Size (bytes)=17 2802026.06 | 70.36 | — | — | 81.72 | |
| MELOVVenue=ACL, #Params=150M, Entity Size (bytes)=17 2802026.06 | 67.32 | — | — | 81.29 | |
| OT-MELMethod Type=Discriminative/OT-based2024.06 | 66.07 | — | — | — | |
| OT-MEL (OT)mechanism=Optimal Transport2024.06 | 66.07 | 82.82 | 87.39 | 75.43 | |
| OTMELVenue=ACL, #Params=150M, Entity Size (bytes)=17 2802026.06 | 66.07 | — | — | 76.57 | |
| OT-MEL (KD)mechanism=Knowledge Distillation2024.06 | 64.82 | 82.29 | 87.25 | 74.65 | |
| MIMIC2024.06 | 63.51 | 81.04 | 86.43 | 73.44 | |
| MIMICVenue=KDD, #Params=150M, Entity Size (bytes)=17 2802026.06 | 63.51 | — | — | 73.44 | |
| ATTmechanism=Attention2024.06 | 63.38 | 81.95 | 87.25 | 73.82 | |
| CLIP2024.06 | 61.21 | 79.63 | 85.18 | 71.69 | |
| ALBEF2024.06 | 60.59 | 75.59 | 81.3 | 69.93 | |
| GHMFC2024.06 | 60.27 | 79.4 | 84.74 | 70.99 | |
| RoBERTa2024.06 | 59.46 | 78.54 | 85.08 | 70.52 | |
| BLINK2024.06 | 57.14 | 78.04 | 85.32 | 69.15 | |
| DZMNED2024.06 | 56.9 | 75.34 | 81.41 | 67.59 | |
| BERT2024.06 | 55.77 | 75.73 | 83.11 | 67.38 | |
| VELML2024.06 | 54.56 | 74.43 | 81.15 | 66.13 | |
| METER2024.06 | 53.14 | 70.93 | 77.59 | 63.71 | |
| JMEL2024.06 | 37.38 | 54.23 | 61 | 48.19 | |
| ViLT2024.06 | 34.39 | 51.07 | 57.83 | 45.22 | |
| GEMELVenue=COLING, #Params=7B2026.06 | — | — | — | 86.3 | |
| I2CRVenue=ACM MM, #Params=8B2026.06 | — | — | — | 92.6 |