Multimodal Entity Linking on RichpediaMEL (test)
83.3Hit@1OT-MEL (OT)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| OT-MEL (OT)backbone=CLIP-ViT-Base-Patch32, mechanism=Optimal Transport2024.06 | 83.3 | 92.39 | 94.83 | 88.27 | |
| OT-MEL (KD)backbone=CLIP-ViT-Base-Patch32, mechanism=Knowledge Distillation2024.06 | 82.57 | 92.06 | 94.44 | 87.78 | |
| MIMICcategory=MEL enhanced2024.06 | 81.02 | 91.77 | 94.38 | 86.95 | |
| ATTmechanism=Attention2024.06 | 78.33 | 91.16 | 94.33 | 85.28 | |
| GHMFCcategory=MEL enhanced2024.06 | 72.92 | 86.85 | 90.6 | 80.76 | |
| DZMNEDcategory=MEL enhanced2024.06 | 68.16 | 82.94 | 87.33 | 76.63 | |
| CLIPcategory=vision-and-language pre-training2024.06 | 67.78 | 85.22 | 90.04 | 77.57 | |
| VELMLcategory=MEL enhanced2024.06 | 67.71 | 84.57 | 89.17 | 77.19 | |
| ALBEFcategory=vision-and-language pre-training2024.06 | 65.17 | 82.84 | 88.28 | 75.29 | |
| METERcategory=vision-and-language pre-training2024.06 | 63.96 | 82.24 | 87.08 | 74.15 | |
| RoBERTacategory=text-based2024.06 | 61.34 | 81.56 | 87.15 | 72.8 | |
| BERTcategory=text-based2024.06 | 59.55 | 81.12 | 87.16 | 71.67 | |
| BLINKcategory=text-based2024.06 | 58.47 | 81.51 | 88.09 | 71.39 | |
| JMELcategory=MEL enhanced2024.06 | 48.82 | 66.77 | 73.99 | 60.06 | |
| ViLTcategory=vision-and-language pre-training2024.06 | 45.85 | 62.96 | 69.8 | 56.63 |