Multimodal Analogy Reasoning on MARS (test)
40.5Hits@1MR-MKG
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MR-MKGBackbone=Visual_LLaMA-2 7B2024.06 | 40.5 | 46.5 | 49.7 | 53.1 | 44.9 | |
| MarT_MKGformerType=MPT, Pre-trained on=MarKG, Backbone=MKGformer2024.06 | 30.1 | 36.7 | 38 | 40.8 | 34.1 | |
| Visual_LLaMA-2 7BBackbone=LLaMA-2 7B, Visual Adapter=true2024.06 | 28.6 | 37.3 | 40.9 | 45.7 | 34.7 | |
| IKRLType=MKGE2024.06 | 26.6 | 29.4 | 30.1 | 31 | 28.3 | |
| RSMEType=MKGE2024.06 | 26.6 | 29.8 | 30.7 | 31.1 | 28.5 | |
| MarT_FLAVAType=MPT, Pre-trained on=MarKG, Backbone=FLAVA2024.06 | 26.4 | 30.3 | 30.9 | 31.9 | 28.8 | |
| TransAEType=MKGE2024.06 | 26.1 | 28.5 | 28.9 | 29.3 | 27.6 | |
| MarT_VisualBERTType=MPT, Pre-trained on=MarKG, Backbone=VisualBERT2024.06 | 26.1 | 29.2 | 30.8 | 32.1 | 28.4 | |
| MarT_ViLBERTType=MPT, Pre-trained on=MarKG, Backbone=ViLBERT2024.06 | 25.6 | 31.2 | 32.7 | 34.7 | 29.2 | |
| MarT_ViLTType=MPT, Pre-trained on=MarKG, Backbone=ViLT2024.06 | 24.5 | 27.5 | 28.7 | 30.3 | 26.6 |